Inspiration

The secret need of having fun in life

What it does

Localises and translates hand gestures and movements in order to control PC - in this case, we use this device as a controlller for "Little Fighters 2" game. It is capable to recognise 5 different states-positions for left hand (e.g. movement in 4 directions and idle state) and 3 different states-gestures for right hand (e.g. attack, defend, idle)

How I built it

It runs on Python and OpenCV for computer vision algorithm and PyAutoGUI for generating keystrokes.

Challenges I ran into

Actually finding the proper idea - we've only started coding around 6pm on Saturday.

Accomplishments that I'm proud of

We've managed to write down simple, but effective implementation of our idea and it actually works! And it's really fun!

What I learned

Sleeping is for the weak. I'm weak. But being more serious, it was a huge lesson of quick projecting and development in strict'n'short time period.

What's next for Natenczas

A lot can be done - improving hand detection algorithms (skin color detection, cascade detection etc.), adding more gestures. Since we can do pretty much anything after we detect event in camera, we could replace keystroke with any other function call. It could be even useful as a computer controller for disabled people.

Built With

Share this project:

Updates