-
Default
-
Guide Reference
-
Guide light
-
Go forward
-
Play / Stop Record
-
Go backward
Inspiration
Our inspiration is to help the outcomes of patients through code. We wanted to help make a difference in the lives of patients and surgeons and improve efficiency during surgerie.
What it does
This is for Demonstration for a surgeon to use hand gestures for easy to access functions during operation. However this software can be applied to elsewhere outside that field.
How we built it
This program is built in Python, and uses OpenCV to allow camera access via python and the Mediapipe library to detect hands from the camera.
Challenges we ran into
We had trouble with hand orientation and sometimes the hand gestures would proc without intention. It was also a challenge on learning so much libraries but it was a challenge that we had a lot of fun doing.
Accomplishments that we're proud of
We are proud that we solved how to have the software recognize unique hand signals and based on that perform a function. This can be edited for further customization
What we learned
We learned a variety of libraries such as OpenCV and Mediapipe. We also brushed up on our Python and learned how to collaborate as a team.
What's next for HandSync
We would like to add camera editing such as brightness, contrast and color. We are also going to be adding more hand signals and to make them more modular for further use. Also improve Mediapipe recognition of hands for more complicated gestures. We can also add further functions outside the medical field.
