Inspiration
Traditional music streaming is restricted to flat 2D screens. We wanted to transform Musixio into a fully immersive, spatial VR music experience tailored for Meta VR headsets, leveraging hands-first interaction and 3D audio visualization.
What it does
Musixio - Spatial VR Music Lounge is a WebXR-compatible music streaming environment. It features a 3D glassmorphic virtual lounge, real-time reactive 3D audio visualizers synchronized with music beats, and controllerless hand-tracking navigation (XRHand) for seamless media controls.
How we built it
- WebXR & Spatial Scene: Built using Three.js and the WebXR Device API (
navigator.xr), featuring floating 3D control panels positioned within a 2-meter seated user comfort radius. - Hands-First Controllerless Interaction: Integrated the WebXR Hand Input API (
XRHand) enabling index-finger raycast pointing and pinch gestures for Play/Pause, track navigation, and volume adjustments. - 3D Audio Visualization & Streaming: Connected the JioSaavn audio pipeline to the Web Audio API (
AnalyserNode) to render real-time frequency-reactive 3D visualizers.
Challenges we ran into
Handling Web Audio API CORS constraints with external audio streams and ensuring smooth frame rates and hand-tracking gesture fidelity across different browser runtimes.
What we learned
Gained advanced expertise in spatial computing design, WebXR hand-tracking integration, and building immersive 3D user interfaces optimized for seated VR experiences.
Built With
- javascript
- lovable
- reach
- three.js
- webxr