-
-
Butterfly Wing Stretch: Guided rhythmic breathwork synced with floating orbs and butterflies in Flowing River Valley.
-
5-Minute Seated Focus: Glowing spatial crystal timer above Sunlit Ocean Cliffs for calm, seated mindfulness.
-
100% Hands-First WebXR Launch: Controller-free 360° nature sanctuary with Aura AI voice travel and palm-up wrist menu.
-
Dewdrop Release Mode: Pinch or tap glowing orbs with 25-joint hand tracking to release sparks, chimes, and butterflies.
-
YouTube Thumbnail///https://youtu.be/m-JWyxgmmT0
Inspiration
Most VR wellness apps require bulky controllers, complex menus, or standing room—making them difficult to use when you actually need to relax, such as at a desk, on a sofa, or on an airplane. We built AmeOrbs to turn any browser on Meta Quest into an instant, zero-friction, 100% hands-first 360° meditation and gentle movement sanctuary.
What it does
AmeOrbs immerses users inside 11 photorealistic 360° real-world nature sanctuaries—from Kyoto's Mossy Forest and Kerala Lagoons to Swiss Meadows and Santorini Dawn—paired with procedural Web Audio soundscapes, glowing interactive dewdrops, and multilingual voice-guided breathwork (English, Hindi, Gujarati, Spanish, and Japanese). • Hands-First Spatial UI (No Controllers Required): Using native WebXR hand-tracking, AmeOrbs renders all 25 joints of both hands in glowing mint (#8CF2D8) and gold (#FFD166). Raising your left palm toward your face reveals a tactile 3D holographic wrist menu that you tap directly with your right index finger to switch worlds or start exercises. Interactive Dewdrop Orbs: Floating golden orbs drift within a comfortable seated reach zone. Pinching or tapping them bursts them into bioluminescent light sparks and triggers procedural pentatonic crystal chimes before gently respawning. 5 Seated Guided Exercises: Includes Wing Stretch (6-4-7-3 rhythmic breathing synced to camera and orb expansion), Neck Gaze, Sky Reach, Dewdrops, and a 5-Minute Focus Timer. Aura AI 360° Travel Guide: Users can speak or type any peaceful mood or destination (e.g., "misty mountain waterfall at sunrise"), and our Gemini-powered /api/aura engine dynamically selects the matching 360° HDRI environment, lighting, butterflies, and generative ambient soundscape.
How we built it
3D & WebXR Engine: Built with Three.js (ZenOrbsEngine.ts) using immersive-vr, hand-tracking, local-floor, and bounded-floor WebXR features, paired with 360° HDRI environments from Poly Haven. Procedural Audio: Engineered a zero-dependency Web Audio API synthesizer (ZenAudioEngine.ts) generating 6 adaptive soundscapes (forest birds, zen stream, alpine wind, rain canopy, ocean waves, temple bells) with automatic music ducking during Web Speech guided instructions. Frontend & AI Backend: Built with React 19, TypeScript, Vite, and Tailwind CSS v4, served via Node.js / Express with a structured /api/aura Gemini endpoint.
Challenges we ran into
Seated Comfort & Nausea Prevention: Ensuring smooth 360° exploration without motion sickness required fine-tuning our optional Slow Glide camera motion and keeping all interactive orbs within an ergonomic seated reach zone. Natural Wrist Menu Ergonomics: Calibrating the left-palm orientation threshold so the 3D wrist menu appears reliably when you look at your palm—without accidentally triggering during breathing stretches—took careful vector math testing.
Accomplishments that we're proud of
• Achieving silky-smooth standalone Meta Quest browser performance with real-time 25-joint hand rendering, procedural synth audio, and zero controller dependency. • Supporting 5 global languages with calm, slow-paced guided breathwork accessible on both Meta Quest headsets and standard desktop/mobile browsers.
What we learned
Ergonomics Matter Most in Seated XR:** Designing for seated spaces (like a desk chair or airplane seat) taught us that subtle adjustments to reach distance (0.5m–1.2m) and palm-orientation thresholds make the difference between effortless hand tracking and arm fatigue.
Procedural Audio Enhances Immersion:** Generating dynamic ambient soundscapes and pentatonic chimes directly via the Web Audio API kept load times nearly instantaneous while making breathwork feel deeply responsive.
Voice + Spatial UI Feels Natural Together:** Combining hands-free voice travel prompts (Aura AI) with tactile palm-up wrist menus eliminates the friction of typing inside a headset.
What's next for AmeOrbs
Mixed Reality Passthrough Mode:** Adding WebXR immersive-ar passthrough support so users on Meta Quest 3 / 3S can float glowing dewdrops and breathing orbs directly inside their real-world living room or office.
Dynamic Breath-Rate Biofeedback:** Using subtle hand-rise and chest/head movement tracking to automatically adapt the 4-7-8 / 6-4-7-3 breathing cadence to the user's natural rhythm.
Shared Multiplayer Zen Circles:** Allowing friends or guided meditation groups to join the same 360° nature sanctuary in WebXR with spatial voice and synchronized breathing orbs.
Built With
- express.js
- node.js
- react
- tailwindcss
- three.js
- typescript
- vite
- web-audio-api
- webxr