Inspiration

Tavern of Tales is an interactive storytelling platform that combines the creativity of tabletop role-playing games with the power of AI. Players can create unique characters, embark on adventures, and make choices that shape their narrative journey. The game features both solo play with an AI Dungeon Master and multiplayer sessions where friends can collaborate on shared stories.

It started with frustration. I love fantasy. I love D&D. But nothing out there captured the magic unless you had hours and a full group. So I built something that does. An AI Dungeon Master that remembers your choices, narrates your adventure, paints the world with images, and lets friends play along.

What it does

Create a character. Choose solo or multiplayer. Start playing. The game responds with fully AI-generated narration, visuals, story progression, combat, quests, and inventory. It remembers your actions, tracks consequences, and supports turn-based multiplayer with character chat and world memory. Every player has their own arc. Every party has their own legend.

How we built it

Frontend: React 18.3 + TypeScript + Tailwind Backend: Supabase for auth, realtime sync, Edge Functions, and database AI: OpenAI GPT for storytelling, DALL·E for images Voice: ElevenLabs narration streamed through Edge Functions Multiplayer: Session state, turn control, player actions, reconnect handling, character-based chat

Modular architecture. Custom middleware. Session-aware memory system.

Challenges we ran into

Voice sync was a nightmare. Getting ElevenLabs to narrate smoothly, match text timing, and feel immersive required weeks of iteration.

Story context and memory was hard to scale. Keeping GPT aware of past actions, quests, inventory, and consequences without breaking pacing was brutal.

Multiplayer nearly broke me. Realtime session logic, reconnect flows, turn validation, and ghost session cleanup were more complex than anything else.

Single player still has issues with milestone tracking and quest branching. The structure is working, but it needs tuning.

Accomplishments we're proud of

It works. It speaks. It remembers. You can log in right now, start a quest, and hear your adventure come to life.

There’s a randomized event system with a character called Gaeto who may appear as a villain, rival, or ally, each time with unique voice, visuals, and behavior.

Admin dashboard is live. Players can be tracked. Characters can be edited. Sessions can be observed and managed in real time.

What we learned

The hard part isn’t AI — it’s making AI feel human. State syncing, edge cases, reconnections, scene timing, session memory — this is what brings immersion. Every new feature touches the entire system. This isn't just a game. It’s a generative engine for fantasy worlds.

What's next for Tavern of Tales

Fix multiplayer bugs and quest tracking in solo mode Add full spellcasting and initiative-based combat Session replay and campaign persistence Voice chat User-created adventures Public quest library Mobile support

Try it live Note, if you want to use the GM account, and use the GM dashboard to see all characters and every sesion login with following credentials, however it is not needed, you can play as guest.

Email: gaeto1992@gmail.com Password: starwars1234

note i had to copy project in bolt MULTIPLE times, and even on github due to sheer size. however its open source!

Built With

Share this project:

Updates