Inspiration

Ever wanted to learn how to dance the cha cha cha but never got to visit a dancing school for some reason? You don't need to feel anxious about performing at the next latin dance party. With Cha Cha Champion, you can experience the cha cha cha right in your living room. Our dance professional Ricardo will surely get things moving.

What it does

Cha Cha Champion is a Mixed Reality App that helps you learning the basic dance moves of the cha cha cha. It shows you how to move your feet to the cha cha rhythm directly on the floor beneath you.

How we built it

  • Cha Cha Champion was built in a team of two. Fabian was responsible for UI/UX, prototyping, video production, concept and texts while Hendrik was responsible for app development, audio, animation and deployment - and dance performances
  • We kicked off with prototyping using ShapesXR. Testing different visuals and animations for the feet.
  • The app was built in Unity3D. It all started with creating our core dance step animation which we really wanted to get right. It was important that users can intuitively grasp how to move according to the music and anticipate the next step.

Challenges we ran into

  • We had to synchronize music to the visuals on the floor. This was tricky because Unity per default loads audio into memory right when it is played and delays replay of the track until it is finished. To ensure that our visuals match the music, we had to preload all audio into memory at startup so everything is in sync.
  • Feedback cycles for standalone development are very long. It can take >30 minutes for a build to be available on the quest device. Since some things can only be debugged / experienced right when using XR, we had to build the app like 20 times during the hackaton which took a significant amount of time. This was amplified because both the Meta Simulator as well as Quest Link were downright unusable because of crashes or abysmal performance.

Accomplishments that we're proud of

  • Early feedback was very positive. People enjoyed engaging with our app. The uplifting music and announcements of Ricardo were funny and motivated us to keep going.
  • A minimalist design stripped down to its essentials, ensuring interactions are straightforward and accessible for everyone.

What we learned

  • Even simple ideas can take a significant amount of time to implement, yet have a lot of potential if executed well.
  • With passthrough, you can create an incredible experience without needing many assets. Your environment becomes your asset pool.
  • Animating with Timeline
  • Meta standalone development using the OVR plugin (as opposed to OpenXR)

What's next for [7] Cha Cha Champion

We'll see :-) but these are things we can think of:

  • Dancing with a partner
  • 3D Avatar of Ricardo with dance moves - Replacement of dance videos
  • Asking Ricardo questions about Cha Cha Cha (Meta Voice SDK)
  • More advanced dance steps like turns, fan, aida, ...
  • Cha Cha Champion giving feedback on your dance performance
    • Dance posture detection
    • Rhythm detection

Built With

  • chatgpt
  • figma
  • flux-dev
  • meta
  • pixabay
  • shapesxr
  • timeline
  • unity
  • xtts-v2
Share this project:

Updates