In Sean's experience with physical therapy and Andy's experience with dance, both project designers have recognized a need for motion instruction that is more intuitive and thorough than static words on a page. Virtual reality is a medium with as-yet unrealized potential for virtualizing human movement, and so this project is an experiment in tracking and instructing correct motion.
What it does
For the first segment, the exercise is demonstrated to the user via an animated 3D character, which can visually display the movement intuitively in physical space. When the user is ready to continue, they are embodied in a 3D avatar where they can perform the exercise themselves. Visual indicators light up green when the movement is performed correctly, providing feedback to the user about the accuracy of their motion.
How we built it
We developed our project in Unity using the SteamVR plugin and using an HTC Vive with additional Vive trackers.
Challenges we ran into
Design challenges included configuring a scene with multiple trackers to enable tracking of multiple body parts, as well as representing user movement with a humanoid avatar.