Inspiration: Fitness is a key part of life which can be difficult to maintain, but new technologies open the door for immersive, engaging, and insightful new means of exercising.

What it does:

Kinetica gamifies different aspects of fitness within a virtual, social context. Individuals can exercise alone, with many others, and with a specialist (trainer, therapist, clinician). Our Hackathon build allows for two people to enter into a beautiful environment where one user(the Trainer) guides the other user (Trainee) through different body movements. These movements could be traditional workout moves (arm raises, curls, squats), sports-specific mechanics(golf swing, yoga, karate maneuvers), dance moves, or physical therapy exercises to promote targeted mobility. The Microsoft Kinect allows for non-intrusive full body tracking with high accuracy and low latency, allowing the user to see a direct overlay of the trainer along with multiple perspectives of themselves.

How I built it

Built with Unity, we are utilizing Oculus Rift for HMD and controller tracking, and Kinect for full body skeletal tracking. We have created a custom backend service running on Google Cloud Services that interfaces with our Unity client to provide realtime data updates about user performance metrics and biosignals.

Challenges I ran into:

-Figuring out how to deploy web server to Google Cloud Platform -Writing Unity scripts to send performance data to web server -Implementing networking and interaction logic between two users -Hooking the Oculus HMD to Kinect - tracked skeleton -Maintaining acceptable frame rates with kinect enabled networked scene.

Accomplishments that I'm proud of

-Excellent Team Dynamic -Wrangling different hardware/ecosystems into an integrated end product: Kinect+Oculus+Networking(Multiplayer)+Connection to Database

What's next for Kinetica

Continue to explore the realm of social, virtual fitness and build towards a healthier future.

Share this project: