Nat One

An AI-powered D&D website where players speak their actions, and the AI Dungeon Master generates story text, scenes, and maps in real time, with dice rolls and player tracking built in.

Comment

Inspiration

We were inspired by the magic of tabletop role-playing games like Dungeons & Dragons — the creativity, collaboration, and unpredictable storytelling that comes from a group of players sharing an adventure. We wanted to recreate that experience online with the help of AI.

What It Does

Nat One is a multiplayer website where users can play Dungeons & Dragons together with an AI-powered Dungeon Master.

  • The AI Dungeon Master listens to the players’ conversations in real time, transcribes their dialogue, and generates new story elements to continue the adventure.
  • The scene display updates dynamically with AI-generated maps or images that reflect what’s happening in the story.
  • Players can view the transcribed dialogue and the AI’s narrative directly on the screen.
  • The interface also includes a player list and a dice roller for quick gameplay actions.

How We Built It

We built Nat One using a combination of front-end web technologies and AI APIs. The Lava API powers story and scene generation, while the Fish API handles the Dungeon Master's voice output using text-to-speech. We connected these APIs through a web interface that manages player interactions, transcriptions, and visual updates.

Challenges We Ran Into

Neither of us had ever implemented an API before, so figuring out how to get the Lava API to generate coherent stories and the Fish API to output the Dungeon Master’s dialogue with an AI voice was a huge challenge. Synchronizing all these systems — the audio, story text, and visuals — to feel natural and responsive took a lot of experimentation.

Accomplishments That We're Proud Of

We’re proud that we created a functional prototype where players can speak, see their dialogue transcribed, and have an AI Dungeon Master respond both through voice and text. Getting multiple APIs to communicate smoothly and bring an RPG world to life felt like a critical win.

What We Learned

We learned how to integrate APIs into a web app, manage asynchronous data flows, and balance user interactivity with AI-generated content. We also gained a deeper appreciation for how complex and rewarding building immersive storytelling systems can be.

What's Next for Nat One

We’d love to expand Nat One with more features, including:

  • Integration with character sheets
  • Ability to bring in NPCs and have different AI voices for each NPC

Our ultimate goal is to make AI-driven storytelling as rich and unpredictable as a real D&D session — where every “Nat One” moment turns into a story worth telling.

Built With

Share this project:

Updates