We really wanted to do a project with computer vision this time around. We settled on creating a system that lets you use simple gestures to control most of the UI functionality on your computer

What it does

The user wears two sleeves on their thumb and index finger, each a different color. We use these as trackers to see where the user's fingers are. They are then able to use gestures to move the mouse, click, scroll and switch between programs

How we built it

We used OpenCV to capture images from the webcam and process the position of the user's fingers. We also used pyautogui which is a library that allows us to control different aspects of the OS's gui.

Challenges we ran into

Originally tried this without any finger sleeves. That produced horrendously awful results and we messed around with that for a while.

Built With

Share this project: