Bootleg Telekinesis

• 

  Detection and Translation of hand

Inspiration

I wanted to be able to do things in 3D and VR without having to use a controller

What it does

Using just your hand (and a webcam) you can take full control of a game with just your hand. In the example I used, I controlled an arm in a 3D VR game. You can move it up, down, left, right, as well as front and back, and finally grab items.

This kind of technology can eventually be used in the medical field (for example with surgeries) as well as assisting people with various disabilities and impairments (helping them learn).

How I built it

I built it using OpenCV to isolate the hand and obtain raw data - from there I used python to figure out where the hand was (coordinates), how far it is, and what symbol it is showing (grabbing).

Challenges I ran into

Connecting Python and Unity was rather difficult to do with the given permissions for file and data parsing

Accomplishments that I'm proud of

This is my first time using OpenCV and controlling my computer without any physical input.

What I learned

I learned how to use part of the OpenCV library

What's next for Bootleg Telekinesis

I hope to add more functionality with multiple hands

DOMAIN FOR DOMAIN AWARD

http://crewdragonisin.space (lol)

Built With

• opencv
• python
• unity