Dream Field Gateways

Human dreams, AI reflections, Immersive encounters

Comment

Inspiration

Dream Field Gateways was inspired by a shared curiosity: what happens when immersive technology is used not to distract or optimize us, but to help us listen inward?

As artists, technologists, and wellness-minded builders, we were drawn to the space between waking and dreaming — a liminal state where reflection, imagination, and meaning surface naturally. We wanted to explore how AI might participate in this space not as an authority or interpreter, but as a dreaming collaborator.

Reality Hack offered the perfect environment to ask a deeper question: Can XR and AI help people encounter their inner worlds with presence, care, and imagination — rather than instruction or outcome?

What It Does

Dream Field Gateways is an AI-driven XR experience where users don't just enter a virtual world — they enter a reflection of themselves, and encounter a dream imagined in return.

Participants enter a liminal XR space — a threshold between waking and dreaming — and engage in gentle vocal conversation with an AI guide. These spoken reflections subtly shape the environment and generate three distinct dream portals:

  1. A Dream You've Had — A remembered dream, rendered as a living interpretation shaped directly from the user's memory and emotional tone.

  2. An Unrealized Dream — A dream not yet lived — formed from aspirations, longings, or paths the user has not fully stepped into.

  3. A Dream Imagined by the AI — A dream created by the AI itself, synthesized from patterns, themes, and emotional signals gathered during the session — not as a prediction, but as an act of machine dreaming.

Each portal produces a short immersive dream video preceded by a brief meditative moment that is intentionally placed within the experience rather than treated as a loading dream screen. After each dream, users return to the liminal space to explore remaining portals or rest.

The AI does not interpret, diagnose, or instruct — it listens, reflects, and dreams alongside the participant.

How We Built It

  • Unity — Primary XR development environment
  • Samsung XR / Android XR — Immersive hardware delivery
  • Google Gemini AI — Conversational intelligence
  • Google Veo 2 — AI-generated dream video content
  • ElevenLabs — Voice synthesis and guided narration
  • STYLY — XR world creation and rapid prototyping
  • Imagen (Google DeepMind) — Visual generation

Voice interaction serves as the core interface, allowing users to remain embodied and present without menus or text input. The system dynamically maps vocal responses to visual, tonal, and narrative parameters that inform each dream portal.

Challenges We Ran Into

  • Designing AI interactions that felt supportive without being interpretive
  • Maintaining emotional safety while working with deeply personal content like dreams
  • Integrating generative video into XR workflows within hackathon time constraints
  • Ensuring meditative pacing felt intentional rather than like a technical delay
  • Balancing poetic language with technical clarity across the experience

Accomplishments We're Proud Of

  • Creating an XR experience centered on presence, reflection, and care
  • Designing an AI that dreams with users rather than explaining them
  • Building a voice-first interaction model that feels intuitive and human
  • Successfully integrating AI-generated video into an immersive XR flow
  • Establishing a clear experiential structure that remains unique for every user

What We Learned

AI can feel more trustworthy when it listens instead of explains

  • Liminal pacing is as important as visual fidelity in immersive wellness experiences
  • Voice interaction deepens embodiment in XR
  • Designing for non-outcomes is both challenging and powerful
  • Dream logic offers a meaningful alternative to productivity-driven interfaces

What's Next for Dream Field Gateways

  1. Expanding dream duration and visual richness
  2. Refining AI dream synthesis to deepen symbolic coherence
  3. Exploring cultural, ceremonial, and therapeutic contexts for guided dreaming
  4. Conducting user studies around wellness, presence, and emotional impact
  5. Developing Dream Field Gateways as a modular platform for XR reflection experiences

Built with care at Reality Hack

Built With

  • andriod-xr
  • elevenlabs
  • git-hub-co-pilot
  • google-gemini-ai
  • google-veo-2
  • imagen-google-deepmind
  • samsung-xr
  • styly
  • unity
Share this project:

Updates