Use image recognition in a unique way to recognize poses. Make something fun!

What it does

A dance along to Village People's YMCA. Touch floating orbs for points as you dance and score bonuses for hitting the Y, M, C, and A poses at the correct time!

How we built it

Enflux's motion capture suit and Unity SDK + IBM Watson's vision recognition API and Unity API.

Challenges we ran into

Getting Watson to correctly classify poses that can be somewhat similar (and even hard for humans to distinguish without context).

Accomplishments that we're proud of

Creating a separate camera that was Watson's view into the game in which we could eliminate noise and give additional cues by color coding limbs (but the user doesn't see this).

What we learned

Full body capture and dancing in VR is quite fun. Even after 24 hours of listening to YMCA, it doesn't get old. Watson is a powerful tool for reducing developer time to create games.

What's next for VirtualVillagePeople

More songs. More dancing. Proving out the utility of recognizing poses in VR.

Built With

Share this project: