Inspiration
We wanted to use motion control to initially help people communicate using a new medium. Our project helps show that natural human gestures, which do not need to be translated, can be sent over the internet.
What it does
Our project allows two users to play a game of rock, paper, scissors over the web.
How we built it
Each user's gestures are read by the Leap motion sensor which is feed into the browser. The browser, using Leap's javascript SDK, figures the gesture made by the user and is sent to the server which takes both inputs and determines the winner.
Challenges we ran into
Figuring the Leap motion's Javascript SDK, creating a small chat client to exchange and determine the gestures information, and deploying the service remotely.
Accomplishments that we're proud of
Making the project actually work, being able to fairly accurately detect the correct gesture the user made, and deploying successfully to a remote host.
What we learned
Sending and receiving messages through Nodejs, gesture detection, and translating physical movement into data.
What's next for Rock, Paper, Scissors, Leap
Improve the accuracy and speed at which our project recognizes gestures. Put in support for American Sign Language and have text to speech to read the input out loud.
Log in or sign up for Devpost to join the conversation.