-
-
immersive view
-
Caterpillar on Bonsai
-
Arashiyama Bamboo Zen Temple
-
Info Kuromatsu
-
Info Sakura Moyogi
-
Info Yama-Momiji
-
Kuromatsu Lake Pagoda view
-
tools - Hasami, Shuro Hoki
-
tools Hishaku
-
Sakura Moyogi Kyoto Lake
-
using a hishaku
Inspiration
In our fast-paced modern world, stress and screen fatigue have become universal challenges. Traditional bonsai cultivation has been celebrated for centuries in Japan not just as horticulture, but as an active form of Zen meditation—teaching patience, mindfulness, and deep harmony with nature.
However, cultivating real bonsai trees requires decades of dedication, strict environmental conditions, and specialized physical tools that most people don't have access to in their living spaces. With the breakthrough capabilities of Meta Quest 3 and its color Passthrough, we asked ourselves: What if anyone could transform their everyday living room into an authentic Kyoto sanctuary and practice the sacred art of bonsai with their bare hands?
That vision gave birth to ZenBonsai: Mixed Reality Oasis.
What it does
ZenBonsai: Mixed Reality Oasis is an immersive, hands-first Mixed Reality botanical sanctuary that places high-fidelity Japanese bonsai trees right on your tabletop.
Key features include:
- Natural Hand Tracking Interaction: No controllers required. Pick up artisan tools, grasp the bamboo water ladle (Hishaku), or prune dry shoots directly using natural pinch gestures and index-finger precision touch.
- Three Distinct Botanical Species:
- 🌸 Sakura Moyogi (Cherry Blossom): Features delicate blooming corollas and drifting 3D petals that sway with procedural physics.
- 🌲 Kuromatsu (Japanese Black Pine): Sculpted with ancient scaled bark, Dan-zukuri foliage cloud pads, and deadwood Jin/Shari veins.
- 🍁 Yama-Momiji (Japanese Maple): An authentic Sokan (dual-trunk) composition with 5-pointed palmate star leaves and vivid autumnal scarlet foliage.
- Individual Real-Time Care & Needs System: Each tree has independent hydration, harmony, and health values. Subtle 3D neon rim indicators illuminate on the table console when a tree requests fresh spring water, precision pruning, or broom cleaning.
- Artisan Tools & Living Water Source:
- Traditional Satsuki Hasami trimming shears with interactive scissor-blade kinematics.
- Soft Hoki bamboo hand broom to gently brush away pests from the trunk and moss.
- Hand-carved stone Tsukubai water basin and bamboo ladle (Hishaku) delivering realistic fluid watering.
- Seamless MR to 360° Virtual Sanctuary Transition: Enjoy the bonsai seamlessly integrated into your physical room, or toggle the 360° Virtual Kyoto Sanctuary featuring an Engawa wooden pavilion, white Karesansui gravel, a koi pond, a vermilion Torii gate, and a conical snow-crowned Mount Fuji.
- Zen Soundscape Synthesizer: Real-time soothing procedural audio including traditional Shakuhachi flute melodies, singing Tibetan meditation bowls, and gentle mountain wind.
How we built it
- Engine & Core Architecture: Developed in Unity 6 (URP - Universal Render Pipeline) specifically optimized for Meta Quest 3 standalone architecture.
- Meta XR Core SDK & OVR Interaction: Implemented direct hand-tracking algorithms with custom fingertip poke-detection (
OVRSkeleton.BoneId.Hand_IndexTip) to eliminate collider offsets and provide millimeter-accurate tactile button responses. - Procedural 3D Botanical Generation: Rather than using static third-party meshes, custom C# procedural algorithms generate smooth Bezier spline trunks, realistic Nebari surface root flaring, organic cambium muscle ridges, and procedural Dan-zukuri cloud pads at runtime.
- High-Definition PBR Materials: Designed custom Albedo and Normal maps ($512 \times 512$) using procedural Perlin noise and mathematical heightfields to simulate authentic mahogany cherry lenticels, aged pine bark scales, and silky Tokoname ceramic glazes.
- Ergonomics & Comfort: Built a low-profile angled table-front console with floating front-facing botanical cards, allowing seated users to reach every control effortlessly without body strain or neck twisting.
Challenges we ran into
- Physical Hand Physics vs. Menu Collisions: Initially, standard Quest hand capsule colliders caused unintended button triggers via palm/knuckle proximities. We engineered a custom index-fingertip proximity solver (
ZenFingerTips) that evaluates exact 3D poke penetration relative to the button face. - Organic Trunk Shading & Depth: Early geometric models showed seam artifacts or flat lighting under mobile shaders. We built dedicated normal-generation math that guarantees $360^\circ$ seamless cylindrical UV mapping and two-sided rendering with solid Z-buffering.
- Ergonomic Virtual Reality Layout: Moving between tools on the table and high-standing signs caused player fatigue. We iterated through multiple designs to consolidate tree selection and status into an angled console mounted directly onto the table's front apron, bringing floating cards directly in front of the seated user when requested.
Accomplishments that we're proud of
- Achieving rock-solid 72/90 FPS performance on standalone Meta Quest 3 without sacrificing visual fidelity or organic leaf counts.
- Designing an interaction model that feels tactile, rewarding, and accessible to anyone—from VR veterans to people trying MR for the very first time.
- Balancing game mechanics with genuine mindfulness: the slow water consumption and calming audio invite players to relax, breathe, and contemplate rather than rush.
What we learned
- The immense power of color Passthrough when grounded with authentic real-world physics and lighting presets (Day, Kyoto Sunset, Zen Lantern Night).
- Fine-tuning pinch gesture thresholds ($0.62$ grab / $0.40$ release) is the key between frustrating tool drops and a magical, frictionless tactile experience.
- Small botanical and cultural details (such as the Maki-e gold trim, Nebari root flaring, and Mono no aware symbolism) elevate a digital 3D model into an emotionally engaging art piece.
What's next for ZenBonsai: Mixed Reality Oasis
- Seasonal Time Progression: Dynamic transitions through Spring blossoms, Summer lush greenery, Autumn golden leaves, and Winter snow coats.
- Bonsai Wire Shaping (Harigane): Allowing users to gently bend young branches using two-handed gesture controls to design custom bonsai styles (Chokkan, Kengai cascade, Bunjingi).
- Physical Room Anchors & Passthrough Meshing: Letting users place the bonsai on any real-life table or shelf in their home using Quest Scene Mesh and Spatial Anchors.
- Social Zen Meditation: A cooperative shared-space mode where two friends or family members can sit together and care for a century-old tree in shared Mixed Reality.
Log in or sign up for Devpost to join the conversation.