Inspiration

I wanted to make physical therapy more fun and effective. Traditional exercises can be tiresome, so I thought of using mixed reality to turn rehab into an interactive experience.

What it does

The project lets users use a stylus (like the MX Ink) to reach and touch floating 3D targets. The system tracks movement, measures accuracy, and gives instant feedback to make rehab exercises engaging and measurable.

How we built it

I used Unity and the XR Interaction Toolkit to create a virtual environment. I added a cursor to represent the stylus tip and 3D targets that move when touched. The system is set up so it can work with the MX Ink stylus when connected.

Challenges we ran into

I didn’t have the MX Ink stylus, so we had to simulate it using an XR controller. Additionally, we had issues with the score system; it wasn’t updating at first, which required troubleshooting the connection between the cursor, target, and score manager.

Accomplishments that we're proud of

I made a working prototype that shows how rehab exercises can be interactive and measured in real time, even without the actual hardware.

What we learned

I learned how mixed reality can enhance rehabilitation and how to set up XR tracking in Unity

What's next for Virtual Rehab Lab

Will add more exercises and track progress. The program will adjust difficulty to make rehab fun and effective.

Built With

  • c#
  • openxr
  • xr-interaction-toolkit
Share this project:

Updates