Hand Gesture Detector

Inspiration

Too much scrolling through instagram/tiktok

What it does

Tracks hand movement live using mediapipes and displays different types of gestures in the console.

How we built it

We utilized kaggle datasets to train a Machine Learning model (Random Forest) to map hand gestures to ASL letters (21 points) with the Google's MediaPipe library.

Challenges we ran into

Issues committing to github because of private variables such as the discord token. Discord runs on some computers because of certifications on macos. Learning how to train models.

Accomplishments that we're proud of

We created our first Machine Learning Model. It displays correct signed letters and speaks in a cool voice. We also put fun easter eggs in there that work well.

What we learned

Learn to use different libraries, implement live camera tracking, training a model from 60000+ images to detect hand signatures, and creating a discord bot.