DungeonGPT

An AI-powered web application to play a game DND-like game with you.

Comment

Inspiration

Besides many things AI and GPT are already doing for us, we decided to make a game to let AI solve boredom!

What it does

It's like a dungeon master, creating stories, and allowing players to interact with it to progress in a story.

How we built it

Utilizing several AI services including GPT-4, Whisper, DALL-E, and Azure Cognitive Services, we created an interactive story that includes live vocal narration, custom image generation, and an interactive story. The web app is created using a Flask python backend and a pure Javascript/HTML/CSS frontend.

  • GPT-4 is used to manage the story and create appropriate prompts to feed into DALL-E.
  • DALL-E is used for image generation for the scene as well as the player.
  • Azure Cognitive Services are used for text-to-speech.
  • Whisper is used for speech-to-text.

Challenges we ran into

  • Prompt engineering to have GPT work as a proper dungeon master
  • Synchronizing files between front-end and backend without exposing API keys
  • Dynamically updating the webpage with various parallel components
  • Proper deployment via Google App Engine

Accomplishments that we're proud of

  • Learning and implementing various new APIs
  • Developing and deploying a full-stack web app
  • Accomplishing every main goal we set out to do in a small time frame

What we learned

  • ChatGPT can be really fun for creative applications
  • How to use most of the technologies given
  • AI tools can be used to interact with each other in creative ways

What's next for DungeonGPT

  • Cleaning up the UI
  • Refining the prompts used for the dungeon master
  • Creating a sustainable payment system so that we don't go broke from our API calls

Built With

Share this project:

Updates