As software developers, we spend a lot of time at a keyboard - and this time puts stress on our bodies that can lead to Carpal Tunnel Syndrome if we are not careful. We designed a system using Leap Motion that can help users become aware of their posture while typing through an interactive typing game.

What it does

The app consists of a typing game where the user enters falling words. The LeapMotion tracks the user's hands over the keyboard. If the user is in a bad position, a tone is played and the hand begins to turn red in the problem area.

How we built it

Unity for GUI, python and SciKitLearn and RandomForest for Machine Learning on detecting compromising hand positions.

Challenges we ran into

Originally we planned on using Python for our entire app, but Leap Motion no longer supports Python with the V4 SDK. Because of this, we were required to use Unity and C# for our main app development.

Accomplishments that we're proud of

Creativity in creating the stand for the leap motion. Integrating an open source typing game as a demonstration tool.

What we learned

First Machine Learning project for Chris and Bright.

Built With

Share this project: