One of our team members has an uncle who has Arthritis. It's very difficult for him to perform daily tasks that require hands and arms. This is a problem not just affecting people suffering Arthritis, but is also present in other diseases such as Parkinson's, Huntington's. Elderly also suffer the same problem. In order to help these individuals to regain their basic motor skills, our team decided to solve this problem.
What it does
AR-itus has 2 main features: Start and Goals. With three exercises - Gestures, dropping, and balance, these exercises evaluate the individual's time, accuracy, and shakiness. By analyzing these three factors, the user is able to practice daily and eventually see themselves progress and improve. With this technology, the user is not only able to train his/her hand eye coordination, but is also able to set SMART goals and view their progress along their journey to a healthier lifestyle.
How we built it
We used Unity, Leap Motion (motion sensor) and the Vive Pro Headset with AR. Our models were made with Cinema 4D and Photoshop.
Challenges we ran into
We had a lot of trouble setting up the hardware for Leap Motion and Vive Pro since SteamVR and the software were not compatible, so we had to edit the settings inside SteamVR to re enable the camera on the Vive Pro. Then, we had an issue of merging two projects since they were on different versions of Unity, and additionally, verifying both SDK's work on the same version of Unity. Additionally, we had other problems with hardware such as missing specific types of cables, and initially not having the Leap Motion until the second day.
Accomplishments that we're proud of
We're proud of being able to implement AR and Leap Motion in this process. Additionally, being able to get the tech to work after spending so much time is a big accomplishment we're proud of.
What we learned
We learnt how to use joints on the rig to determine specific hand signals based on the Vector positions, and how AR setup is different compared to VR setup on Unity. We also learnt how to make a flowing UI for better user interaction.
What's next for AR-itus
In order to make AR-itus more fun and interactive, implementing a virtual store where users can buy customization skins from earning credits by completing exercises would greatly improve reception of this application.