Eternity POV AI Demo

Hands-free AI wearer-POV on Quest. Merges digital & physical worlds using Passthrough Camera + Hand Tracking. Inspired by Loop Lab & Wearables Toolkit.

Comment

Inspiration

Inspired by Meta’s Loop Lab, Wearables Device Access Toolkit and the recent “This is fantastic! 💎” shout-out from @MetaHorizonDevs on my comments. The goal is true hands-free, wearer-POV immersion where digital and physical realities merge seamlessly — no controllers, just natural hand gestures and AI-driven context.

What it does

Eternity POV AI Demo is a Quest-native experience that uses Passthrough Camera + Hand Tracking + on-device AI to overlay intelligent digital content directly onto the real world from the user’s exact point of view. Think real-time AI assistant, contextual object recognition, and shared mixed-reality memories — all completely hands-free.

How we built it

  • Unity 2022 + Quest SDK
  • Meta Passthrough & Hand Tracking APIs
  • On-device ML via TensorFlow Lite / MediaPipe
  • Loop Lab tools for rapid AI prototyping
  • Wearables Toolkit early access for future glasses-ready features

Challenges we ran into

Balancing performance on standalone Quest while keeping AI responsive and passthrough stable. Solved by aggressive optimization and selective model quantization.

Accomplishments that we're proud of

  • Fully standalone Quest experience with stable passthrough + responsive on-device AI
  • Natural hand-tracking interactions without controllers
  • Real-time contextual overlays directly in user’s POV

What we learned

How critical model quantization and draw-call optimization are when combining heavy passthrough + AI on Quest 3/3S.

What's next for Eternity POV AI Demo

  • Full App Lab release Q1 2026
  • Multiplayer shared POV sessions
  • Ready for Orion glasses launch
  • Integration with Meta’s upcoming AI assistant APIs

Demo video (45 sec): https://youtu.be/caARil2maYw?si=myFtgXFWpiS-97OS Private test build available on request via Meta Developer Dashboard (Eternity Mind Studios).

Excited to push Horizon OS boundaries together!

Built With

  • access
  • device
  • hand-tracking-api
  • loop-lab
  • mediapipe
  • passthrough-camera-api
  • quest-sdk
  • tensorflow-lite
  • unity
  • wearables
Share this project:

Updates