Mr.Vibes

• 

  Titel and Logo

The Big Inspiration: Get Outta Your Head!

We were tired of tech that turns you into a digital ghost, sucked completely out of your body and surroundings. So, we cooked up MR.Vibes! . MR. Vibes is a mixed reality experience created to make moving more fun and stimulating. A stark contrast to the current addictive technologies that entrap you in a static seated position while you doom scroll your day away, MR. Vibes rewards you the more variety there is in your physical movements, with every bit of movement affecting what you're seeing and hearing. Most tech separates us; MR.Vibes is here to do the opposite. it's a digital high-five that helps you reconnect with your awesome physical self and your living room!.

What it does: Shake your Hands and control the music

Right now, the party is mostly in your hands (but we have big plans!). There is a particle effect (VFX graph) attached to each hand. These effects enable you to express yourself physically and encourage you to move around and discover their capabilities:

• Velocity is Vibe: The speed (v) of your hand movements changes the particle effects emanating from your palms. Faster movement means more vibrant colors and a greater number of musical instruments increasing the volume!
• Electric Effects: High-speed hand movements also boost the intensity of particle turbulence, making the visual effect look more electric and charged—like you're conducting a storm!
• Vertical Volume: The vertical position (Y-axis) of your hands controls the rate at which particles are produced. Want a visual explosion? You'll have to crouch down low and stretch all the way up! This forces a full-body movement range.
• Immersive Audio Hug: Using FMOD, all sounds move dynamically around the head and are placed on invisible emitters. This fully spatialised audio creates a deep sense of immersion and enjoyment. There is currently a choice of three songs you can play on a record player that comes up when you make the ‘rock on’ hand gesture.
• Being in Mixed Reality passthrough mode: Furthermore, we created different 'zones' that require you to physically move into them in order to experience them. For example, moving forward into the 'pink zone' transforms the passthrough into a pink filter and restricts your audio control to the guitar only. Moving to another zone would change the passthrough color and controllable instrument.

How we built it

Over the course of three weeks, a team of four people spread across the world built MR. Vibes in Unity for the XRCC Online Hackathon 2025. For the Meta Start Horizon Developer Competition, we upgraded our experience by adding multiplayer features with the Meta Avatar SDK. This allows you to focus on physically connecting with your body in the local version and virtually connecting with friends in the multiplayer version.

• The Blueprint: The project was shared and managed via GitHub.
• The Foundation: We built it using Meta's Building Blocks.
• The Soundtrack: The music and spatial audio were managed with the FMOD plugin.
• The Multiplayer experience: We added Meta Avatars and Network Avatar from Meta. ## Challenges we ran into Our initial plan was ambitious. We wanted to spatialise the sound by having one emitter on each hand and controlling the music with the whole body. While this would have been an interesting feature, it would not have been 360 audio since there is no hand tracking behind your head. To counteract this, we decided to use dynamic audio emitters in the space, limiting them to hand tracking to guarantee a richer, more immersive soundscape. ## Accomplishments that we're proud of We hit our first major milestone by delivering a working .apk file for submission! While it may only achieve the bare minimum of what we had hoped for, it is stable, functional and, most importantly, great fun to play and dance around with! We can even play with friends. ## What we learned We learned a crucial lesson about time management versus ambition. We poured too much time into trying to get foot tracking to work, aiming for a full-body experience right out of the gate. Foot tracking proved too complex for the initial timeframe, and while it would have been an amazing feature, it stole time from other essential polishing. ## What's next for Mr.Vibes
• Full Body Fun: In the future, we would also like to add more effects and tracked body parts to make the experience even more dynamic.
• Local Multiplayer: There will be a local multiplayer option that lets you enjoy the visual and audio effects together.
• More Interactions: Expanding the interaction logic beyond just velocity and vertical position to include more subtle and dynamic movements. Control of Pitch in songs.
• Customization: Allowing users to select different visual particle themes and audio tracks.

Built With

• fmod
• metaavatars
• metablocks
• unity