Beginner track submission :)
Inspiration
It's really fun to play games with new control schemes - and using your body to control characters is even more fun!
What it does
The project tracks a hand and uses it's position in the camera frame to send inputs to the game selected on launch, sending a "W" to jump when the hand is brought to the top portion of the frame, a "D" to go forward when on the right side, and so on.
How we built it
We used Google's Mediapipe ML library to track the hands, and then added in some custom code to select the game window and send keyboard inputs to it.
Challenges we ran into
The Mediapipe library has a lot going on - it was definitely challenging figuring out how to incorporate our own functionality into it.
Accomplishments that we're proud of
Making the project :)
What we learned
We learned a bunch about a handful of really cool Python libraries
What's next for handController
We plan to use handController to create some interactive games that we can share for new students and to recruit new CS club members!
Log in or sign up for Devpost to join the conversation.