Inspiration
Traditional productivity apps force us into flat 2D screens or heavy room-scale setups that violate natural daily comfort. We wanted to build something built entirely around human ergonomics—turning everyday routines (morning briefings, deep focus, and evening wind-downs) into a seamless spatial experience. Inspired by the need for complete privacy and low-resource efficiency, we envisioned a workspace that runs entirely on-device, leveraging local intelligence without relying on cloud servers or controllers.
What it does
NexusFlow is an offline-first, hands-first spatial productivity studio designed for Meta VR devices. It allows users to manage tasks, schedules, and daily routines using purely natural hand gestures (pinching, grabbing, and throwing cards) within a comfortable 2-foot seated radius. By summoning an intuitive local agent via a palm-up gesture, users can speak or gesture complex organizational prompts, letting the on-device AI instantly parse, structure, and spatialize their workflow into a 180-degree ergonomic workspace.
How we built it
Engine & XR Integration: Built using Unity with the latest Meta XR SDKs to achieve buttery-smooth, low-latency hand tracking and precise physics interaction.
Agentic Layer: Integrated a lightweight, quantized local language model running entirely on-device to handle intent parsing and task structuring offline.
UI/UX Design: Engineered custom spatial panels and curved layouts optimized specifically for seated use, ensuring a fast cold start and compliance with the "airplane seat test."
Challenges we ran into
Hand-Tracking Thresholds: Fine-tuning the pinch-and-release physics so that minor hand tremors didn't accidentally drop or misalign task cards.
On-Device Performance: Balancing local agent response times while maintaining a steady framerate inside the headset to prevent motion fatigue.
Seated Ergonomics: Designing a 180-degree arch that feels spacious and natural without requiring physical movement or roomscale tracking.
Accomplishments that we're proud of
Achieving a 100% controller-free loop where every interaction—from sorting tasks to invoking the agent—feels entirely natural and tactile.
Successfully running a local agentic workflow on-device with zero cloud latency or internet dependency.
Creating an instant "first five minutes" experience that drops users straight into a polished, responsive productivity loop.
What we learned
Simplicity in hand gestures beats complexity; users prefer clean, reliable pinches over convoluted multi-finger poses.
Offline-first AI architecture forces hyper-efficient state management, which dramatically improves overall app performance and stability in VR.
What's next for NexusFlow
Expanding routine templates for specialized workflows (e.g., developer debug sprints, creative writing blocks).
Introducing advanced local multi-agent routing for deeper automated task breakdown.
Publishing to the Meta VR Store as a go-to daily micro-workspace for remote professionals.
Log in or sign up for Devpost to join the conversation.