Inspiration

As gamers, we wanted to push the definition of LLMs in games in order to create a truly immersive experience.

What it does

Unlike games that let the LLM generate things freeform, we propose a structure that keeps the LLM grounded in a narrative, but provides a new paradigm for how players can interact with games through LLMs.

How we built it

The game engine was built on Godot, connecting directly to Gemini 3 via HTTP stream.

Challenges we ran into

The biggest challenge was figuring out how we could control the player actions so that it is feasible, and limiting how much the player could actually affect the game.

Accomplishments that we're proud of

The game structure is versatile enough that it can be applied to multiple styles of games, including our current mystery RPG, and even other genres like resource management tower defense games.

What's next

The LLM engine can be refined into a library. Unlike current engines which are open ended, by defining specific ways an LLM can plug into a game, it can become easier for game studios to incorporate LLMs into their workflows.

Built With

Share this project:

Updates