VR AI Designer

Inspiration

From VR Subway Surfers to vibe creating an immersive story, we were inspired by harnessing the power of AI to immerse the user.

What it does

Generates scenes that depict creative stories, settings that inspire. All through the power of AI, you no longer have to manually open an editor, open a tool, all you need is a sentence.

How we built it

We used Unity and Python FAST API for the backend, Claude code for the coding support, Google Cloud Vertex AI for the model and task reasoning into structured output.

Challenges we ran into

Generating large/complex assets Rotation Collision

Accomplishments that we're proud of

Unity AI isn't able to reason about the user's design choices. Through our LLM, we can make Unity objects for any design task.

What we learned

How to use agentic tools and connect various tools How to balance ideation and implementation

What's next for VR AI Designer

Generate objects upfront from use case → generate scenes every call Story reasoning → text output into Unity AI

Built With

• c#
• fastapi
• gcp
• python
• vertex