Inspiration

Not long ago, I started playing Dungeons & Dragons with some friends, and I was amazed by how immersive it is to step into a character’s shoes and try to survive in a dynamic world. That experience sparked a deep curiosity: what if I could recreate something similar using Artificial Intelligence?

I started playing around with ChatGPT as a Game Master, and while it was fun and surprising, I noticed it lacked certain features—like remembering inventory or letting past decisions influence the story. That’s when the idea hit me: what if I could build my own AI-powered adventure engine?

What it does

The project creates a fully immersive, AI-driven role-playing experience. Users step into a character and are guided through dynamic, evolving storylines by an AI Game Master. It tracks inventory, past decisions, and player stats, all while narrating the experience with realistic voiceovers using ElevenLabs and adaptive background music to enhance immersion.

How we built it

We started by using ChatGPT as the core language model for story generation and decision-making logic. Then, with Bolt, we built a structured flow for gameplay, including inventory handling, event memory, and branching paths.

To deepen the immersion:

  • ElevenLabs was used for generating realistic voice narration.
  • Background music was dynamically integrated to match the story tone.
  • Prompts were carefully crafted to simulate a live, responsive Game Master.

Challenges we ran into

  • Getting the AI to remember context like inventory and character stats consistently.
  • Syncing narration with scene transitions and pacing the story naturally.
  • Ensuring players didn’t feel lost or overwhelmed by too many branching options.
  • Balancing freedom of choice with narrative coherence.

Accomplishments that we're proud of

  • Turning a simple idea into a functioning prototype.
  • Creating a playable solo RPG experience with natural-sounding narration.
  • Building a modular system that can be expanded into multiplayer campaigns.
  • Managing to blend storytelling, AI, voice synthesis, and music in a cohesive way.

What we learned

  • AI storytelling can be incredibly powerful but needs structure to stay coherent.
  • Voice synthesis adds a surprising emotional depth to even AI-generated stories.
  • Tools like Bolt are key in orchestrating complex flows without writing huge codebases.
  • Even with powerful models, designing user-friendly experiences requires careful tuning and iteration.

What's next for Your AI-powered portal to infinite worlds of adventure

  • Expanding the system for multiplayer, so friends can join the same AI-led campaign.
  • Adding custom character creation and stat-based skill checks.
  • Letting players upload their own assets (voices, images, lore).
  • Building a web app version where people can save progress and resume sessions.
  • Introducing modding tools so others can build their own AI-driven adventures.

This is just the beginning. The portal to infinite worlds is opening, one story at a time.

Built With

  • bolt
  • elevenlabs
  • mistral
  • supabase
Share this project:

Updates