Inspiration
The secret need of having fun in life
What it does
Localises and translates hand gestures and movements in order to control PC - in this case, we use this device as a controlller for "Little Fighters 2" game. It is capable to recognise 5 different states-positions for left hand (e.g. movement in 4 directions and idle state) and 3 different states-gestures for right hand (e.g. attack, defend, idle)
How I built it
It runs on Python and OpenCV for computer vision algorithm and PyAutoGUI for generating keystrokes.
Challenges I ran into
Actually finding the proper idea - we've only started coding around 6pm on Saturday.
Accomplishments that I'm proud of
We've managed to write down simple, but effective implementation of our idea and it actually works! And it's really fun!
What I learned
Sleeping is for the weak. I'm weak. But being more serious, it was a huge lesson of quick projecting and development in strict'n'short time period.
What's next for Natenczas
A lot can be done - improving hand detection algorithms (skin color detection, cascade detection etc.), adding more gestures. Since we can do pretty much anything after we detect event in camera, we could replace keystroke with any other function call. It could be even useful as a computer controller for disabled people.


Log in or sign up for Devpost to join the conversation.