Inspiration: Fitness is a key part of life which can be difficult to maintain, but new technologies open the door for immersive, engaging, and insightful new means of exercising.
What it does:
Kinetica gamifies different aspects of fitness within a virtual, social context. Individuals can exercise alone, with many others, and with a specialist (trainer, therapist, clinician). Our Hackathon build allows for two people to enter into a beautiful environment where one user(the Trainer) guides the other user (Trainee) through different body movements. These movements could be traditional workout moves (arm raises, curls, squats), sports-specific mechanics(golf swing, yoga, karate maneuvers), dance moves, or physical therapy exercises to promote targeted mobility. The Microsoft Kinect allows for non-intrusive full body tracking with high accuracy and low latency, allowing the user to see a direct overlay of the trainer along with multiple perspectives of themselves.
How I built it
Built with Unity, we are utilizing Oculus Rift for HMD and controller tracking, and Kinect for full body skeletal tracking. We have created a custom backend service running on Google Cloud Services that interfaces with our Unity client to provide realtime data updates about user performance metrics and biosignals.
Challenges I ran into:
-Figuring out how to deploy web server to Google Cloud Platform -Writing Unity scripts to send performance data to web server -Implementing networking and interaction logic between two users -Hooking the Oculus HMD to Kinect - tracked skeleton -Maintaining acceptable frame rates with kinect enabled networked scene.
Accomplishments that I'm proud of
-Excellent Team Dynamic -Wrangling different hardware/ecosystems into an integrated end product: Kinect+Oculus+Networking(Multiplayer)+Connection to Database
What's next for Kinetica
Continue to explore the realm of social, virtual fitness and build towards a healthier future.