GenAI Video Game Levels

What it does

Use a one-word theme to generate game assets for a simple game

How we built it

Godot project sends a request to OpenAI server

Challenges we ran into

GenAI image model we used struggled a lot in understanding the concept of a tilemap that will be used in level creation and kept trying to generate an entire level. Possible workarounds are a fine tuned model trained off other tilemaps

Accomplishments that we're proud of

Interacting with OpenAI API through a Godot game

What we learned

More about how image generators work and how they interpret (and misinterpret) prompts

What's next for GenAI Video Game Levels

Move the image generation workflow into a cloud server that does a lot of post processing to build a full tilemap that can be sent back to the game. Expose the cloud server with an API and point the game there.

Built With

• genai
• godot
• openai
• python
• unity