HandiCapable

Inspiration

... Being unable to write or do useful tasks with hands is a very painful and difficult experience. Having been through this personally while injured and not being able to write has been a challenge, and this is challenge for millions of people who are undergoing injury to their hands and are in need of therapy and rehab to regain hand motor skills.

What it does

HandiCapable is an app that allows users to regain muscle control and motion back in their hands while undergoing therapy and rehabilitation. We use a set of therapist recommended exercises to calibrate a range of motions for a persons hand, and then we have a preset set of hand motions which consititutes a therapy regimen of rehab exercises to help regain motor function in hands. We selected those exercises which are geared towards the motions commonly associated with writing, typing and manipulating writing instruments like pens, pencils, books and paper.

How we built it

We used react native for building the app. We take accelerometer readings from the device onboard sensors using the react sensors package. There is a calibration process when each person's baseline motion is determined. Then, the data is sent to the backend for similarity matching. The backend has an ML model to match movement using dynamic time warping, which is a measure to calculate similarities between two time series. This is deployed as a Google cloud function.