Wizard's Grove

Inspiration

I love 3D sandbox games. However, while playing these games, I always thought "it would be so much more fun if I could create items and NPCs with greater freedom." In recent years, advancements in AI have made it possible to generate Three.js code. AI generation speeds have also improved significantly. I realized that by leveraging AI, we could create a mechanic that allows users to generate items in real-time within the game.

What it does

Wizard's Grove is an AI-powered 3D sandbox where players create their own magical village. Players enter text prompts into a magical "Grimoire," and Claude AI generates custom 3D models on the fly - from NPCs with unique personalities to rideable vehicles and interactive buildings. Players can:

・Generate unlimited NPCs, buildings, objects, and vehicles through AI ・Have AI-powered conversations with generated NPCs ・Physically grab, move, and arrange objects in the 3D world ・Ride generated vehicles and explore their custom world ・Complete quests and unlock achievement titles ・Build sprawling villages with AI-generated architecture

How we built it

We created the prototype for this game using Claude and deployed it on Vercel. For error fixes, we used Claude Code and Codex. Item generation utilizes the Anthropic API, enabling real-time object creation within the game. Generating .fbx or .glb files would have taken far too long. It's precisely because we used Three.js that we were able to achieve real-time generation.

Challenges we ran into

The main challenge was implementing functionality for each item type. We categorized generated items into genres such as buildings, NPCs, and vehicles, and prepared specific features for each genre. Setting up collision detection for buildings proved particularly difficult and didn't work as expected at first. We also put significant effort into creating a feature that dynamically changes NPC dialogue and characteristics based on user prompts. Through countless iterations of dialogue with the AI, we refined the mechanics and design.

Accomplishments that we're proud of

・Seamless AI Integration: Successfully integrated Claude API to generate executable 3D code in real-time - turning text into functional game objects in seconds ・Rich Interactions: Built a comprehensive interaction system where players can grab, rotate, and place any generated object, including massive buildings ・AI Conversations: Implemented personality-driven NPC conversations where each character maintains consistent traits and speech patterns ・Visual Polish: Created a beautiful pastel-colored aesthetic with dynamic lighting, particle effects, and smooth animations that make the magical world feel alive ・Quest & Achievement System: Designed an engaging progression system with 5 unique titles to earn

What we learned

We discovered that AI doesn't create characters and buildings by visually "seeing" them the way humans do. We often noticed that AI's sense of spatial relationships—front, back, left, and right—differs from human perception. In AI-assisted game development, we learned the importance of a process where humans review what the AI creates, make corrections along the way, and iteratively refine it toward the ideal form.

What's next for Wizard's Grove

Share creations: Publish created villages and make them playable for other users Advanced NPC behavior: Expand NPC AI with jobs, relationships, and autonomous activities Enhanced building system: Interior decoration, multi-story buildings, and furniture placement Visual enhancements: Add weather systems, day-night cycles, and seasonal changes to bring the world even more vividly to life

Built With

• javascript