AI powered fiction-based RPG game

Users can input some texts to create a virtual world. And users can play a role in this world, make critical decisions and win to achieve some specific goals

Comment

Inspiration

Games are the best platform to bring people together. The inspiration for our project comes from a board game called "Script Murder," where each person plays a character in a virtual world. Our breakthrough is using AI to create new scripts and characters, generating new plotlines in real-time based on players' decisions. To our best knowledge, this is the first try to combine generative AI tools with fiction-based RPG games.

What it does

This is an AI powered fiction game where each user can play a role in this fiction, make many critical decisions and win to achieve some specific goals.

How we built it

We use openai-4o to generate the world descriptions and characters information based on prompts. And we use DALLE3 model to generate the appearence of characters and background scenes. After collecting the players' decisions, the LLM will generate the new plot based on the difference decision.

We built a python server that provides image generations based on prompts. And we developed a website-based interface by next.js. gRPC was used to communicate bewteen the fronted and server.

Challenges we ran into

  • find the light but powerful model to keep the quality of images and speed the inferences.
  • remove the characters' background
  • design the clean and beautiful website interfaces
  • implement complicated game logic

Accomplishments that we're proud of

  • we built a powerful server to support the image generating.
  • we implemented an efficient algorithm to remove the characters' background.
  • we used next.js to build a clean and beautiful interfaces
  • we make the game run correctly as we expected.

What we learned

  • how to deploy LLM models by gRPC.
  • how to develop complicated LLM-based game.
  • how to processing the multiple players logic

What's next for AI powered fiction-based RPG game

  • add the background music track
  • extend our game from two players mode to multiplayers mode
  • optimize the inference speed

Built With

Share this project:

Updates