Project Pitch: BaristAR – Spatial Cafe

  1. Tagline / Elevator Pitch "BaristAR is a cozy, atmospheric mixed reality experience where you step behind the counter of your own spatial cafe. Craft coffees and cappuccinos using intuitive Hands-First interactions and engage in natural voice conversations with unique AI-driven patrons, all while enjoying a scenic window view over Amsterdam's rain-kissed canals."

  2. Concept & User Experience Cozy Spatial Mixed Reality: Using Passthrough and Meta Spatial Anchors, your real-world table seamlessly transforms into the coffee counter. A virtual window opens in front of you, revealing a dynamic, immersive 3D scene (starting with autumnal Amsterdam featuring soft lighting and atmospheric rain).

Hands-First Interaction: Designed completely without controllers. You interact naturally with the espresso machine, portafilter, and milk pitcher using intuitive hand gestures (Pinch, Grab, Tilt) powered by the Meta Interaction SDK.

Ethereal AI-Powered Patrons: Customers are not photorealistic humans, but elegant, glowing silhouettes that keep the experience lightweight and visually enchanting. Integrated with an AI voice agent (Inworld AI), patrons place their orders and engage in real-time, context-aware voice conversations while you craft their drinks.

Diegetic UI (The Vintage Globe): A vintage globe sits on your counter, serving as a fully interactive map to preview future destinations (e.g., Kyoto, New York) without breaking immersion with 2D menus.

  1. Highlights for Meta Judges & Category Fit Hands-First Innovation: Fully embraces Meta’s key requirement for tactile, natural, and controller-free gameplay using the Meta Interaction SDK.

Best Agentic Interaction / AI Integration: Uses real-time AI voice agents to drive rich NPC dialogues, making every customer interaction unique and dynamic.

Cozy Mixed Reality Appeal: Blends Mixed Reality with the popular "cozy gaming" genre, appealing to both VR enthusiasts and non-gaming audiences.

  1. Technical Overview Engine: Unreal Engine 5 (Forward Shading, Vulkan RHI, MSAA 4x, Mobile Multi-View targeting 72/90 FPS native performance on Meta Quest 3).

Meta SDKs: MetaXR Plugin, Meta Interaction SDK, Meta Audio SDK, and Spatial Anchors API.

AI & Voice Stack: Inworld AI SDK for microphone input handling, context processing, and real-time audio streaming.

Visuals & Audio: Stylized PBR models for clean visuals, paired with 3D spatialized ASMR audio (steaming milk, rain, ceramic cups) to deliver a polished, cozy environment.

Built With

Share this project:

Updates

Submission history