Inspiration

Machine learning is complicated. Let's make it easy for people to train it. Let's keep it modular so we can add new positions easily. Let's use leap motion because it's cool.

What it does

Input a new position name-> show us that hand position -> it gets added to your library of saved positions Go to identify positions -> show hand position -> our web app will tell which of your saved positions you have shown

How we built it

Web app in Node.JS interfaces with leap and formats data, Python script using tensorflow is called on the data and returns the value to the web app to be displayed

Challenges we ran into

Tensorflow is nice but really complicated, transfering data from python script to node.js is also difficult

Accomplishments that we're proud of

WE MADE MACHINE LEARNING WORK IN LESS THAN 24 HOURS

What we learned

How to train a model, how to write a web app

What's next for leap-gesture

Be able to export the models for each gesture so it can be used in other apps

Share this project:

Updates