1. Team Lead's Phone Number: +1-289-4565184
  2. Location: 232, Table 3

Link to video: https://youtu.be/CPxVluWBPfw


Strokes… they’re a life changing experience and every year more than 800,000 people in the U.S. suffer from one. Strokes can result in one becoming nearly paralysed in half of their body and thus require extensive physical and occupational therapy in order to regain at least part of their functionality back. The team lead, Jomar Gacoscos, works in the rehabilitation sciences and he helps patients go through rehab. He saw that conventional therapy can be boring and repetitive, even depressing at times. Treatment includes having to do elbow extension 50 times or putting 50 pennies in jar, while stuck in the same hospital setting for weeks. What if new technology could ease and help the patients do these exercises daily, and even look forward to them?

What it does

To help stroke patients, we’ve created an engaging VR experience that simulates being outside by a beautiful pond. Motion sensing device(leap motion) tracks the patient’s arms and hand movement as the patient reaches back and forth delivering pieces of virtual bread to the virtual ducks. It’s an experience that not only encourages patients to do their therapeutic range of motion exercises, but helps bring joy by transporting them to a charming and engaging environment.

How we built it

The environment was built in Unity as was the development of the hand gestures and the animation of the ducks. The environment and the animated ducks were then transferred to the main project where it was all put together, tested and iterated several times.

Challenges we ran into

The experience of 3D modeling in Unity was challenging because our team did not have a 3D designer. We overcame this obstacle by utilizing Creative Commons and by self-learning how to build our own objects. Another challenge we encountered was maintaining a high frame-rate throughout the entirety of our virtual reality experience.

Accomplishments that we're proud of

Working together in a interdisciplinary team, we provided a solution to patient's needs, which is supported by our project lead's clinical experience and backed by medical research. By using new and emerging technologies, we gamified rehabilitation and hope to make an impact on the health industry. We provide an immersive and engaging virtual reality experience, which serves as an alternative to traditional physical therapy for stroke patients. We are proud to have created an experience that stroke patients can try out and test.

What we learned

We learned how to use motion tracking to take input from a user's hand motions in a virtual reality environment. We realized the significance of animating and creating interactive environments in Unity for an immersive VR experience. From a project process point of view we learned how to trust each other and be honest about our abilities when working towards a common goal.

What's next for StrokeRehabVR

We want to test it with users to find aspects of the experience that need modification. We have implemented a built-in progression system, that slowly encourages the patient to use a bigger range of motion as they become better at the game. We plan on making that system more complex depending on the severity of the stroke based on user feedback. We're also working on another level, in which patients help an animated ladybug move from one leaf to another without falling.

SDK's used:

LeapMotion SDK(https://developer.leapmotion.com/get-started/) SteamVR SDK(https://assetstore.unity.com/packages/templates/systems/steamvr-plugin-32647)

Art Assets used:

Nature Pack Extended(https://kenney.nl/assets/nature-pack-extended)

Share this project: