PhantomVR

Inspiration

Our group was really interested in VR technology after hearing Vena's presentation during workshop. We then explored what applications in healthcare VR would be helpful for. That's when we discovered phantom limb pain.

What it does

The project creates a custom, at-home solution for patients experiencing phantom limb pain. It adapts software to render realistic 3d limbs for VR applications. This use case is valuable for not only phantom limb pain and also other physical therapy patients with neurological disorders.

How we built it

We built a UI prototype in figma to show our mobile app that takes photos from the user's intact limb to generate a model of the missing limb that can be used in VR gaming.

Challenges we ran into

We ran into problems with using Unity because no one in the group had experience with it. To tackle this, we used skills we already had, such as prototyping in figma, to represent our idea.

Accomplishments that we're proud of

We created a figma UI prototype to show how our mobile app interface asks the user for pictures and will generate a 3d model file to be used in their VR headset.

What we learned

We learned that creating apps for Oculus (a VR headset) requires a specific setup in Unity to configure everything correctly. We also learned that this is a large-scale idea and requires more time for implementation. It also required integration with hardware and could not be accomplished in only a day. We also learned how to animate our prototype in figma which our group did not know how to do before.

What's next for PhantomVR

PhantomVR wants to continue developing the 3d scanning app. We want to add an AI algorithm that can generate 3d models from inputted images. We want to integrate our 3d models into VR games that can be used for physical therapy. We also want to implement coordinate-based tracking to analyze therapy sessions and provide performance statistics. Lastly, we want to use predictive modeling with EMG data to show the user's movements in the VR headset.

Built With

• figma