Inspiration

Most VR wellness apps require bulky controllers, complex menus, or standing room—making them difficult to use when you actually need to relax, such as at a desk, on a sofa, or on an airplane. We built AmeOrbs to turn any browser on Meta Quest into an instant, zero-friction, 100% hands-first 360° meditation and gentle movement sanctuary.

What it does

AmeOrbs immerses users inside 11 photorealistic 360° real-world nature sanctuaries—from Kyoto's Mossy Forest and Kerala Lagoons to Swiss Meadows and Santorini Dawn—paired with procedural Web Audio soundscapes, glowing interactive dewdrops, and multilingual voice-guided breathwork (English, Hindi, Gujarati, Spanish, and Japanese). • Hands-First Spatial UI (No Controllers Required): Using native WebXR hand-tracking, AmeOrbs renders all 25 joints of both hands in glowing mint (#8CF2D8) and gold (#FFD166). Raising your left palm toward your face reveals a tactile 3D holographic wrist menu that you tap directly with your right index finger to switch worlds or start exercises. Interactive Dewdrop Orbs: Floating golden orbs drift within a comfortable seated reach zone. Pinching or tapping them bursts them into bioluminescent light sparks and triggers procedural pentatonic crystal chimes before gently respawning. 5 Seated Guided Exercises: Includes Wing Stretch (6-4-7-3 rhythmic breathing synced to camera and orb expansion), Neck Gaze, Sky Reach, Dewdrops, and a 5-Minute Focus Timer. Aura AI 360° Travel Guide: Users can speak or type any peaceful mood or destination (e.g., "misty mountain waterfall at sunrise"), and our Gemini-powered /api/aura engine dynamically selects the matching 360° HDRI environment, lighting, butterflies, and generative ambient soundscape.

How we built it

3D & WebXR Engine: Built with Three.js (ZenOrbsEngine.ts) using immersive-vr, hand-tracking, local-floor, and bounded-floor WebXR features, paired with 360° HDRI environments from Poly Haven. Procedural Audio: Engineered a zero-dependency Web Audio API synthesizer (ZenAudioEngine.ts) generating 6 adaptive soundscapes (forest birds, zen stream, alpine wind, rain canopy, ocean waves, temple bells) with automatic music ducking during Web Speech guided instructions. Frontend & AI Backend: Built with React 19, TypeScript, Vite, and Tailwind CSS v4, served via Node.js / Express with a structured /api/aura Gemini endpoint.

Challenges we ran into

Seated Comfort & Nausea Prevention: Ensuring smooth 360° exploration without motion sickness required fine-tuning our optional Slow Glide camera motion and keeping all interactive orbs within an ergonomic seated reach zone. Natural Wrist Menu Ergonomics: Calibrating the left-palm orientation threshold so the 3D wrist menu appears reliably when you look at your palm—without accidentally triggering during breathing stretches—took careful vector math testing.

Accomplishments that we're proud of

• Achieving silky-smooth standalone Meta Quest browser performance with real-time 25-joint hand rendering, procedural synth audio, and zero controller dependency. • Supporting 5 global languages with calm, slow-paced guided breathwork accessible on both Meta Quest headsets and standard desktop/mobile browsers.

What we learned

Ergonomics Matter Most in Seated XR:** Designing for seated spaces (like a desk chair or airplane seat) taught us that subtle adjustments to reach distance (0.5m–1.2m) and palm-orientation thresholds make the difference between effortless hand tracking and arm fatigue. Procedural Audio Enhances Immersion:** Generating dynamic ambient soundscapes and pentatonic chimes directly via the Web Audio API kept load times nearly instantaneous while making breathwork feel deeply responsive. Voice + Spatial UI Feels Natural Together:** Combining hands-free voice travel prompts (Aura AI) with tactile palm-up wrist menus eliminates the friction of typing inside a headset.

What's next for AmeOrbs

Mixed Reality Passthrough Mode:** Adding WebXR immersive-ar passthrough support so users on Meta Quest 3 / 3S can float glowing dewdrops and breathing orbs directly inside their real-world living room or office. Dynamic Breath-Rate Biofeedback:** Using subtle hand-rise and chest/head movement tracking to automatically adapt the 4-7-8 / 6-4-7-3 breathing cadence to the user's natural rhythm. Shared Multiplayer Zen Circles:** Allowing friends or guided meditation groups to join the same 360° nature sanctuary in WebXR with spatial voice and synchronized breathing orbs.

Built With

Share this project:

Updates

Submission history