Inspiration
I wanted to reach out to someone in VR and feel that my touch truly mattered.
Traditional virtual characters have always felt emotionally distant—every interaction simply triggers the same pre-recorded animation loop. Real living beings don't operate on predictable scripts. They possess an inner biological pulse: a heartbeat that flutters with sudden proximity, subtle vascular flushes, and a gentle emotional afterglow that lingers even after a hand pulls away.
I wanted to feel genuine emotional warmth in spatial computing, rather than mechanical repetition. Because existing experiences lacked this living, responsive presence, I set out to build it myself.
Backed by our two proprietary patent-pending architectures, Synapse VR Operator replaces canned animation loops with real-time autonomic bio-emulation. By computing physiological states directly on Meta Quest, we bring living, breathing biological warmth to hands-first spatial computing.
What It Does
Synapse VR Operator is a seated-optimized, hands-first spatial prototype demonstrating real-time autonomic bio-emulation on Meta Quest:
- Calculated in Real-Time Through Physiological Formulas: The entity never replays canned emotional clips. Instead, calculated in real-time through physiological formulas, it delivers a genuinely living, dynamically responsive sensation to the user. Contact duration, approach velocity, touch area, and proximity directly influence internal nervous tension and biological states in real time.
- Hands-First Spatial Interaction (Zero Controller Dependency): Users interact exclusively through natural hand tracking. Reaching forward, holding out an open palm, touching the cheek, or making gentle contact initiates seamless biological responses without pressing a single controller button.
- Multi-Sensory Biological Feedback:
- Dynamic Heartbeat Pulse: Real-time autonomic calculations drive the core's pulse rate, accelerating with initial surprise and settling into rhythmic calm during gentle, steady contact.
- Vascular Luminescence & Afterglow: Emotional excitation propagates through dynamic emissive shaders, leaving a natural 2 to 4-second biological afterglow as touch subsides.
- Interactive Gaze Following: The entity’s gaze naturally follows the user's hand and presence to maintain attentive eye contact.
- Seated-Optimized Ergonomics: Calibrated strictly within a 2-foot (60cm) interaction radius (the "airplane seat test"), ensuring completely comfortable, stationary spatial interaction without requiring roomscale physical movement.
How We Built It
- Engine & Rendering Stack: Unity 6 (6000.3.27f1) with Universal Render Pipeline (URP) optimized for mobile XR.
- Meta Horizon SDK Integration:
- Meta XR Core SDK (v207.0.0).
- OpenXR Plugin (v1.17.0) & Unity XR Hands (v1.7.2) for pure optical hand tracking.
- Meta XR Simulator for precision gesture calibration alongside standalone Android ARM64 Quest builds.
- Deterministic Bio-Emulation Architecture:
- A decoupled C# StateCore mathematical engine running sub-millisecond updates without runtime GC allocations.
- Multi-tiered emotional state vectors driving procedural blend shapes, inverse kinematics (IK), dynamic pulse lighting, and spatial audio feedback.
- Shader Craft:
- Custom mobile URP shaders for multi-layer subsurface emission, dynamic pulse glow, and biological afterglow fading.
Summary of Significant Updates (Adapted Experience)
Pre-Competition Baseline: Prior to the competition window, an early conceptual desktop/PC prototype existed to explore basic character touch mathematics.
Significant Updates Built During the Competition Window (Sep 24 – Nov 2026):
- 100% Hands-First Migration: Completely re-engineered interaction layers from legacy mouse/controller inputs into a native OpenXR Hand Tracking pipeline. The entire experience is now fully operable using only natural hands, with zero controller prerequisites.
- Seated Ergonomic Calibration: Re-tuned spatial interaction bounds to a strict 60cm (2-foot) spherical radius with exponential smoothing filters to eliminate optical hand tracking jitter.
- Real-Time Bio-Feedback Pipeline Integration: Connected patent-pending mathematical state vectors directly to heartbeat pulse rhythms and emissive surface afterglow shaders.
- Native Meta Quest Standalone Deployment: Optimized rendering passes and CPU overhead to achieve smooth 72/90fps performance natively on Meta Quest 3 and Quest 3S hardware.
Challenges We Ran Into
- Optical Hand Tracking Jitter: High-frequency micro-movements in optical hand tracking created unnatural jitter during delicate touch interactions. We implemented predictive exponential smoothing filters and contact hysteresis zones, delivering silky-smooth, reliable touch responsiveness.
- Balancing Biological Differential Math with Mobile XR Performance: Running continuous physiological differential formulas alongside skeletal IK on a mobile chip required strict zero-allocation memory management and cache-friendly data structures.
Accomplishments That We're Proud Of
- We created a completely controller-free spatial experience that delivers palpable emotional warmth and organic presence without relying on scripted tricks.
- Proving that mathematical bio-emulation creates a fundamentally deeper sense of life than traditional pre-recorded NPC animations.
What We Learned
Spatial presence is not just about visual polygon counts; it is deeply rooted in biological timing and non-linear responsiveness. When an entity's pulse and gaze react organically to human touch with physiological plausibility, the sense of living connection becomes instantaneous.
What's Next for Synapse VR Operator
- Expanding our international patent portfolio (PCT filing) covering physical haptic robotics and spatial autonomous agents.
- Integrating wearable biometric inputs (heart rate, respiration) to establish a bidirectional, closed-loop emotional resonance between human and virtual lifeform.
- Official publishing on the Meta Horizon Store.
