Inspiration
I wanted to make something using ML as I was really interested in it, and I thought Impractical Hackers is a perfect place to make something goofy and try out new things.
What it does
It is a Machine Learning based doodler app. Its let's you doodle by just moving your hand in front of the camera, it detects the whole hand as well as individual fingers. It also has some cool gesture recognition. P.S. The tip of your index finger acts as the tip of the pen
How we built it
The web app is built using ReactJs, but the part where magic happens is throught TensorflowJS and its libraries(handpose, fingerpose)
Challenges we ran into
The main challenge was to understand how to use TensorflowJS as it was my first time ever building a project related to machine learning. The next challenge was to find a way so the tip of the pen becomes the index finger.
Accomplishments that we're proud of
I am really happy that I was able to complete my first project that has something to do with machine learning, from scratch
What we learned
I learned how to use TensorflowJS in a project and how cool is Machine Learning. TensorflowJs, handpose, fingerpose
What's next for Magic Fingers
Built With
- fingerpose
- handpose
- javascript
- react
- tensorflowsjs
Log in or sign up for Devpost to join the conversation.