Inspiration

You want to learn Ballroom Dancing BUT:

  • “Private lessons are too expensive!”
  • “Can’t keep up in group classes!”
  • “Too shy to dance in front of others!”
  • “Keep forgetting dance steps!”
  • “No partner to practice with!”
  • “Keep stepping on my partner’s feet!”

What it does

Dance Guru is a Mixed Reality Virutal Dance instructor and dance learning platform that is affordable, Personalized, and Social.

Learn popular Ballroom Dances and more: Waltz, Tango, Rumba, Foxtrot, Mambo, Quickstep, Swing, Cha-Cha, Jive

  1. Room Scanning: Scans your physical space for suitable dance floor area
  2. Dance Steps Tracking: Visualize choreography footsteps in your physical space
  3. Virtual Dance Partner: Practice with virtual partner for consistent improvement
  4. AI Voice Interaction: Natural Language Interaction powered by wit.ai
  5. Social Multiplayer: Party with other dancers virtually, participate in challenges and events
  6. Progress Tracking: Motivate with progress tracking and goal setting

How we built it

Using Meta's Presence Platform SDK:

  1. Depth API: Occlusion of virtual objects behind physical objects
  2. Scene API: scan physical environment, and map out dance footprints.
  3. Passthrough API: Bring virtual dance Instructor into your physical space
  4. Interaction SDK: Interaction with Menus using natural hand movement
  5. Hand Tracking API: Guide virtual partner with the correct hand position
  6. Movement SDK: Detect user’s body posture and give feedback for improvement

Challenges we ran into

No feetracking, so we hacked it by strapping the quest controllers onto the feet.

Accomplishments that we're proud of

thinking outside the box and coming up with ways to track the feet eventhough there is no existing solution for that.

What we learned

-creating a mixed reality app that uses your entire body. -using as many mixed reality capabilities as we possibly can, to experiment with the potentials that mixed reality can unlock.

What's next for Dance Guru

Avatar SDK: Customize skins, costumes and accessories Multiplayer integration: Socialize with others up to 20 people , using Photon Fusion

Built With

Share this project:

Updates