What it does

Provides an easier way for people with Parkinson's to use computers

How we built it

We used Mediapipe to extract hand joint coordinates, OpenCV to record testing data, and Tensorflow to create an RNN

Challenges we ran into

Creating all 3930 training videos Optimizing the RNN

Accomplishments that we're proud of

Making an AI which can categorize gestures and perform their respective actions with decent accuracy

What we learned

How to create video training data How to use Mediapipe to classify gestures

Built With

Share this project:

Updates