Use image recognition in a unique way to recognize poses. Make something fun!
What it does
A dance along to Village People's YMCA. Touch floating orbs for points as you dance and score bonuses for hitting the Y, M, C, and A poses at the correct time!
How we built it
Enflux's motion capture suit and Unity SDK + IBM Watson's vision recognition API and Unity API.
Challenges we ran into
Getting Watson to correctly classify poses that can be somewhat similar (and even hard for humans to distinguish without context).
Accomplishments that we're proud of
Creating a separate camera that was Watson's view into the game in which we could eliminate noise and give additional cues by color coding limbs (but the user doesn't see this).
What we learned
Full body capture and dancing in VR is quite fun. Even after 24 hours of listening to YMCA, it doesn't get old. Watson is a powerful tool for reducing developer time to create games.
What's next for VirtualVillagePeople
More songs. More dancing. Proving out the utility of recognizing poses in VR.