Inspiration

Kids have big imaginations but small hands — they can't build the worlds they dream up.

We wanted to give them something simpler than a screen: just put on a pair of glasses, speak, and watch your story come alive in the room around you.

Dreamopia started from a simple question — what if a child's bedtime story could walk right into the bedroom?


What it does

Dreamopia runs on Snap Spectacles AR glasses and has two modes:

  • Story Mode
    A child speaks a story idea and an AI narrator generates a children's story in real time — reading it aloud while 3D animals appear in the room, react to the plot, and disappear when their scene ends.

  • Agent Mode
    Kids can speak freely: "put a fox on my left" or "make it snow" — and it just happens.
    The whole room becomes the storybook.


How we built it

  • The AR layer is built in Lens Studio (TypeScript)

    • 3D animal spawning
    • Idle animations
    • Particle effects (snow, fireflies, rainbows)
    • Typewriter subtitle system
  • The AI backend runs on Botpress ADK + Claude

    • Generates structured JSON story beats
    • Maps directly to scene commands
  • Communication

    • Botpress Chat API
    • Custom polling loop on the Lens side

Challenges we ran into

  • 3D assets not appearing due to a scene hierarchy parenting bug
  • AR coordinate confusion
    • Objects unintentionally attached to the camera
  • No WebSocket support in Lens Studio
    → Required building a custom HTTP polling layer

Accomplishments that we're proud of

  • Fully working end-to-end loop
    → A child speaks → AI writes → AR scene appears in seconds

  • AI-driven scene control

    • Decides what appears, where, and when
    • Not just narration — true interaction

👉 Feels closer to a living picture book than a chatbot.


What we learned

  • AR has high *“invisible friction” *

    • Scene hierarchy
    • Coordinate systems
    • Asset formats
  • Structured outputs matter
    → Using strict JSON made integration far more reliable than free-form text


What's next for Dreamopia

  • More animals and environments
  • Fully animated characters
  • Parent companion app
  • Memory system
    → Pip the fox remembers the child and past adventures

Built With

Snap Spectacles, Lens Studio, TypeScript, Botpress ADK, Claude (Anthropic), Cerebras Chat API, Speech-to-Text API, Text-to-Speech API, Spectacles Interaction Kit

Built With

  • lenstudio
Share this project:

Updates