One of the leading causes of worker injuries is ergonomics, where factory workers, construction workers, and even regular staff put themselves at risk when they move heavy equipment or materials. Since our team has experience in machine learning, we wanted to see if there was a way we could harness the power of computer vision and machine learning to detect these high risky poses and alert workers when they perform them so they can continue to live happy healthy lives.
What it does
Given permission to your computer's camera, the web app takes the live feed and identifies when you are in a potentially dangerous pose which can injure you. When it detects this, the bar on the page turns red.
How we built it
We used PoseNet from ml5.js for pose detection and we used p5.js for marking the specific keypoints and drawing the skeleton. We used machine learning for detecting potentially dangerous poses and notifying the person.
Challenges we ran into
Accomplishments that we're proud of
It works! Even after facing a lot of challenges, and starting pretty late, we were able to make this project.
What we learned
What's next for SafePose
- Adding hardware! We would like to deploy our model on a remote camera which can then beep or light up to alert people when they are in an unergonomic pose.
- Authentication and login! We want our users to only have access to their cameras.