Inspiration

In our fast-paced modern world, stress and screen fatigue have become universal challenges. Traditional bonsai cultivation has been celebrated for centuries in Japan not just as horticulture, but as an active form of Zen meditation—teaching patience, mindfulness, and deep harmony with nature.

However, cultivating real bonsai trees requires decades of dedication, strict environmental conditions, and specialized physical tools that most people don't have access to in their living spaces. With the breakthrough capabilities of Meta Quest 3 and its color Passthrough, we asked ourselves: What if anyone could transform their everyday living room into an authentic Kyoto sanctuary and practice the sacred art of bonsai with their bare hands?

That vision gave birth to ZenBonsai: Mixed Reality Oasis.

What it does

ZenBonsai: Mixed Reality Oasis is an immersive, hands-first Mixed Reality botanical sanctuary that places living Japanese bonsai trees directly onto your physical tabletop.

Key features include:

  • Natural Hand Tracking Interaction: 100% controller-free. Pick up artisan tools, grasp the bamboo water ladle (Hishaku), bend young branches with pinch gestures, or prune withered shoots with index-finger tactile precision.
  • Physical Table Alignment (Meta MRUK): Automatically detects and anchors the bonsai garden to your real-world furniture using Meta Quest's Scene API, creating a seamless blend between reality and digital nature.
  • Four Artisan Tools & Botanical Rituals:
    • Satsuki Hasami (鋏): Forged steel shears with dynamic blade kinematics for mindful shoot pruning with high visual feedback.
    • Hishaku (柄杓): Handcrafted bamboo water ladle delivering realistic fluid watering into the stone Tsukubai basin to hydrate living moss.
    • Harigane Spool (針金): Traditional copper wire spool that lets players bind and sculpt living branches freely in 3D space with natural pinch-and-bend hand interactions.
    • Shuro Hōki (棕櫚箒): Natural palm broom to gently sweep caterpillars and pests off procedural bark surfaces.
  • Three Authentic Botanical Species:
    • 🌸 Sakura Moyogi (Cherry Blossom): Features delicate blooming corollas and drifting 3D petals that sway with procedural physics.
    • 🌲 Kuromatsu (Japanese Black Pine): Sculpted with ancient scaled bark, Dan-zukuri needle cloud pads, and deadwood Jin/Shari veins.
    • 🍁 Yama-Momiji (Japanese Maple): An authentic Sokan (dual-trunk) composition with 5-pointed palmate star leaves and vivid autumnal scarlet foliage.
  • Living 360° Sanctuaries with Dynamic Waters: Seamlessly toggle between your room's Passthrough and three breathtaking 360° environments:
    • Mount Fuji Veranda: Sunlit engawa veranda overlooking stone waterfall basins, a sculpted Torii gate, and an open pond with free-roaming Koi fish.
    • Kyoto Mirror Lake: Moonlit five-story Pagoda, arched Moon Bridge, flowing water ripples, and schools of swimming Koi in 360°.
    • Arashiyama Zen Temple: Raked sand Karesansui rock gardens, cedar architecture, and tranquil evening breeze.
  • Master Rank Progression & Keeper's Journal: Progress from Novice apprentice to Grand Master (Meijin). Track your lifetime pruning, hydration, wire-sculpting milestones, and mindfulness minutes on an interactive parchment scroll.
  • Binaural Spatial Soundscape: Real-time soothing procedural audio including traditional Koto harp, Shakuhachi flute, singing Tibetan bowls, and gentle mountain wind.

How we built it

  • Engine & Core Architecture: Developed in Unity 6 (URP - Universal Render Pipeline) specifically optimized for Meta Quest 3 and Quest Pro standalone architecture.
  • Meta XR Core SDK & MRUK Integration: Implemented direct hand-tracking algorithms with custom fingertip poke-detection (OVRSkeleton.BoneId.Hand_IndexTip) to eliminate collider offsets and provide millimeter-accurate tactile responses. Integrated Meta MRUK (Mixed Reality Utility Kit) for automatic physical table snapping and spatial meshing.
  • Procedural 3D Botanical Generation: Rather than using static third-party meshes, custom C# procedural algorithms generate smooth Bezier spline trunks, realistic Nebari surface root flaring, organic cambium muscle ridges, and procedural foliage clusters at runtime.
  • Real-Time Spline Branch Bending: Built a custom runtime 3D spline deformation engine that recalculates mesh rings and bark tangents in real time as the player pinches and bends branches with their bare hands.
  • High-Definition PBR Materials & Shaders: Designed custom Albedo and Normal maps ($512 \times 512$) using procedural Perlin noise and mathematical heightfields to simulate authentic cherry lenticels, aged pine bark scales, flowing water ripples, and silky Tokoname ceramic glazes.
  • Ergonomics & Comfort: Built a low-profile angled table-front console with floating front-facing botanical cards and parchment scrolls, allowing seated users to reach every control effortlessly without neck strain.

Challenges we ran into

  1. Physical Hand Physics vs. Menu Collisions: Standard Quest hand capsule colliders caused unintended button triggers via palm/knuckle proximities. We engineered a custom index-fingertip proximity solver (ZenFingerTips) that evaluates exact 3D poke penetration relative to the button face.
  2. Organic Trunk Shading & Branch Continuity: Early geometric models showed seam artifacts where branches joined the trunk. We implemented smooth procedural collar geometry, unified bark normal sampling, and two-sided rendering to create natural, seamless branch unions across all three species.
  3. Free-Roaming Koi & Dynamic Water on Mobile GPU: Simulating schools of 18 swimming Koi with obstacle avoidance around the pagoda and central pavilion while maintaining rock-solid frame rates required writing lightweight harmonic path equations and procedural UV water drift shaders instead of heavy physics calculations.

Accomplishments that we're proud of

  • Achieving rock-solid 72/90 FPS performance on standalone Meta Quest 3 with complex organic geometry, 18 swimming Koi, animated water surfaces, and particle systems.
  • Designing a 100% controller-free hand interaction model that feels natural, tactile, and rewarding—from subtle wire bending to water pouring.
  • Creating a genuine mindfulness oasis where the combination of authentic Japanese gardening rituals, spatial audio, and mixed reality grounding provides real stress relief.

What we learned

  • The immense power of Meta Quest 3 color Passthrough when grounded with real-world table surfaces (MRUK) and dynamic ambient lighting.
  • Fine-tuning pinch gesture thresholds ($0.62$ grab / $0.40$ release) is the key between frustrating tool drops and a magical, frictionless tactile experience.
  • Small botanical and cultural details (such as Nebari root flaring, Harigane wiring, and Mono no aware symbolism) elevate a digital model into an emotionally engaging art piece.

What's next for ZenBonsai: Mixed Reality Oasis

  • Seasonal Time Progression: Dynamic real-time transitions through Spring cherry blossoms, Summer lush greenery, Autumn golden maple foliage, and Winter frost.
  • Additional Traditional Species: Introducing Juniper (Shimpaku), Japanese Wisteria (Fuji), and Ginkgo Biloba with specialized care mechanics.
  • Social Zen Meditation: A cooperative shared-space mode where two friends or family members can sit together and care for a century-old tree in shared Mixed Reality.
  • Biofeedback & Apple Health / Meta Quest Move Integration: Connecting heart-rate monitors to adapt environmental weather and soundscapes according to the player's relaxation levels.

Built With

  • android
  • c#
  • game-development
  • hand-tracking
  • haptics
  • meta-quest-3
  • meta-xr-sdk
  • mindfulness
  • mixed-reality
  • mobile-vr
  • pbr-materials
  • procedural-generation
  • spatial-audio
  • unity
  • urp
  • virtual-reality
  • zen
Share this project:

Updates

Submission history