We were inspired by our friend, Joey, who had a stroke when he was a baby and lost motor skills in his right hand. We learned that he has spent hundreds of thousands of dollars on physical therapy sessions and thought we could make a new form of treatment that was less costly. Therefore, PTVR was created.

What it does

PTVR, which stands for Physical Therapy in Virtual Reality is an application that allows the user to strengthen their motor skills through it's interactive exercises. The user can use their own hands to play several of the exercises that include connect-the-dots, darts, etc. At the end of each level, a text message is sent (through the Twilio API) to the patient's physical therapist to track their progress.

How we built it

We used Unity and C# to build for the Oculus Rift + Leap Motion. Also we used a Python web server with the Twilio API to send the patient's progress to his/her doctor.

Challenges we ran into

  • Connecting and setting up the Oculus Rift + Leap Motion
  • Creating a server to run the Python code
  • Sharing code between team members
  • Creating Hand Collisions with UI elements in Unity

Accomplishments that we're proud of

  • Getting all three levels to be functional
  • Configuring the Twilio API with query parameters so that the message changes based on the level.
  • Implementing a scoring system based on a Stopwatch timer in C#.

What we learned

  • A whole bunch of Collisions and Object Interactions in Unity.
  • Integrating the Leap Motion objects properly.
  • AWS is more annoying than we thought.

What's next for PTVR

We plan to make more detailed score reports that are sent to the patient's therapist using email as well as text message. We also want to make the UI a little more appealing, with ease of movement through the levels.

Share this project: