Orbital Beats

Inspiration

Orbital Beats was inspired by the idea of transforming the way music is created and experienced. Users could interact with music in a visually immersive environment, using the power of MR to manipulate sounds through intuitive gestures, making music creation accessible and engaging for everyone, regardless of their musical background.

What it does

Orbital Beats allows users to create and manipulate music through audio orbs. Users can generate these orbs with simple hand gestures, each orb representing a different sound. By manipulating these orbs in a 3D space, adjust effects and compose music dynamically in a MR environment.

How we built it

The project was developed using several Meta XR SDK’s. We integrated spatial audio to ensure an immersive experience and used motion tracking to capture user gestures for orb manipulation. Passthrough and Room Mesh were used to blend the real and digital world.

Challenges we ran into

One of the challenges was optimizing the real-time audio processing to minimize latency.. Fine tuning the interactions was also a challenge.

Accomplishments that we're proud of

The ability to blend audio creation with XR to create a functional and engaging music creation tool. We are also proud of adding our virtual assistant sky who guides you through the experience.

What we learned

We learned a lot about the nuances of XR development, especially in user experience / interface design and the synchronization of audio and visual elements.

What's next for Orbital Beats

We plan to expand the library of sounds and effects available in Orbital Beats, allowing for even more creative possibilities. Additionally, we aim to develop a collaborative feature that will enable multiple users to create music together in real-time, regardless of their physical location.