Inspiration
Machine learning is complicated. Let's make it easy for people to train it. Let's keep it modular so we can add new positions easily. Let's use leap motion because it's cool.
What it does
Input a new position name-> show us that hand position -> it gets added to your library of saved positions Go to identify positions -> show hand position -> our web app will tell which of your saved positions you have shown
How we built it
Web app in Node.JS interfaces with leap and formats data, Python script using tensorflow is called on the data and returns the value to the web app to be displayed
Challenges we ran into
Tensorflow is nice but really complicated, transfering data from python script to node.js is also difficult
Accomplishments that we're proud of
WE MADE MACHINE LEARNING WORK IN LESS THAN 24 HOURS
What we learned
How to train a model, how to write a web app
What's next for leap-gesture
Be able to export the models for each gesture so it can be used in other apps
Log in or sign up for Devpost to join the conversation.