We came to the hackathon already wanting to do something health related. We then found out about the possibility to play around with Leap Motion and we immediately went for it. In the beginning it was supposed to be a sign language interpreter, but after some deliberation we concluded that there's a more useful concept we could pull off.

The Project

This is a web app that uses Leap Motion to help people suffering from RSI (Repetitive Strain Injury) or Carpal tunnel to reduce their pain and improve wellbeing by offering and monitoring exercises.

The app was made mostly in Python - we used Leap API for Python, implemented a machine learning algorithm and trained the model to distinguish between hand gestures, which allowed us to check whether users are doing their exercises and providing a step-by-step live instructions. For live updates, we used websockets to communicate between back-end and front-end.

Share this project: