Inspiration

We looked at the autonomous systems being built today, and we felt something was missing. They're brilliant at being reactive—at following the rules and staying in their lane.

But the real world isn't about perfectly following rules. It's about chaos.

We were inspired by human racers. Think of a professional driver: they aren't just reacting to the car in front of them. They're anticipating a rival's move three turns ahead. They're learning from every single lap. And when a sudden storm hits or a car spins out, they don't just stop—they adapt in a split second.

That sparked our big question: What if we could build an AI that does the same?

What if an AI could be more than just a perfect, robotic driver? What if it could be strategic, adaptive, and even a little... human? An AI that learns from its past failures, predicts its opponent's next move, and can handle a world where anything can go wrong at any moment.

We wanted to build that future. That's why we created AgniMotion—to see if we could teach AI to not just navigate our world, but to truly thrive in its chaos.

What it does

AgniMotion creates a high-speed virtual racetrack where advanced AI agents, human players, and total chaos collide.

Instead of just following a set path, our AI racers actually learn and evolve. They have unique "DNA"—virtual personalities with traits like 'Aggression' or 'Caution'—that mutate and get passed down from one race to the next. You can literally watch them get smarter over generations.

As a user, you get to play two key roles:

Test the AI: Jump into the driver's seat of a Hypercar and see if your human skill can beat our evolving AI.

Play God: Use the "Chaos Injection Console" to change the race in real-time. Trigger an EMP blast, start a weather storm, or open a wormhole to see if the AI can handle a world that breaks all the rules.

While all this happens, an AI Commentator (powered by Gemini) gives you live, human-like voice commentary on the action. You can monitor every agent's "Emotion," track their "Eco Score," and compare them against a "Predictive Ghost" showing the perfect lap.

In short, AgniMotion lets you watch, test, and participate in the live evolution of intelligent, chaos-resilient AI.

How we built it

We built AgniMotion by combining three powerful layers: an immersive 3D world, a real-time data "backbone," and a cutting-edge AI "brain."

💻 The 3D World (The Frontend) To bring our neon-lit cyberpunk city to life right in the browser, we used React and Three.js. This combination allowed us to build a lightning-fast, interactive user interface and a complex 3D world on the same page. We manage our own 60-FPS physics loop to ensure every crash, drift, and boost feels smooth and responsive.

☁️ The Real-Time Backbone (The Backend) We needed a backend that was as fast as our racers. We chose Supabase as our central nervous system. It handles all our user authentication, stores our Global Leaderboard, and saves every agent's "DNA" and race history. Most importantly, Supabase's Realtime features let us instantly update leaderboards and race data for everyone, making the world feel truly live.

The Intelligence (The AI) This is where the magic happens.

The "Brain": The live race commentator is powered by Gemini (Lovable AI). We send it real-time data about the race (like overtakes, crashes, and chaos events), and it generates intelligent, human-like insights.

The "Voice": That analysis is then sent to ElevenLabs, which gives our commentator its dynamic, realistic voice.

The "DNA": The core agent evolution and the "Predictive Ghost" aren't just one API. They're our own custom-built ML algorithms that run continuously, calculating new optimal paths and mutating agent DNA based on their performance.

We tied all these AI services together using Edge Functions, which are like tiny, super-fast servers that run our AI logic instantly from the cloud, ensuring there's no lag between the race action and the AI's reaction.

Challenges we ran into

The 60 FPS "Boss Battle" Our biggest opponent wasn't an AI racer; it was the browser. We're running a full 3D physics simulation for 20+ agents, on top of a complex React interface, and live data visualizations. At first, it was a slideshow. We had to obsessively optimize every single line of code, fine-tune our physics loop (requestAnimationFrame), and strategically manage how React re-renders to ensure the entire experience stays locked at a smooth 60 FPS.

Making the AI Feel "Alive," Not Just "Perfect" It's easy to make an AI that follows a perfect line. It's incredibly hard to make one that learns and has a personality. Our first "genetic algorithm" attempts created agents that either drove straight into walls or were so cautious they never passed anyone. We spent days balancing the "DNA" traits (Aggression, Strategy, etc.) and tuning the "Emotion Engine" so that an "Aggressive" agent actually takes more risks, and evolution actually produces smarter, more competitive racers over time.

The 8-Second AI Commentator This was a massive engineering challenge. We have just 8 seconds to:

  1. Capture the current, chaotic state of the race (who's passing, who crashed).

  2. Send that data to the Gemini API and ask for an intelligent insight.

  3. Get the text response back from Gemini.

  4. Send that text to the ElevenLabs API to generate realistic speech.

  5. Stream the final audio file back into the game.

Accomplishments that we're proud of

Our AI Actually Evolves. This isn't just a pre-programmed "Hard Mode." We built a fully functional evolutionary system from scratch. We are incredibly proud that you can genuinely watch our AI agents, with their unique "DNA," get smarter, faster, and more strategic as they pass their successful traits down through generations. We created high-speed, digital survival-of-the-fittest.

The "Live" AI Commentator (Our 8-Second Miracle) This was a massive technical gamble that paid off. We successfully built a real-time pipeline that, every 8 seconds, analyzes the race with Gemini, generates a human-like voice with ElevenLabs, and streams it back into the game. Doing this without lagging the 60 FPS physics simulation was a huge challenge, and it makes the entire experience feel alive. It's not a recording; it's a live AI, watching the race right alongside you.

We Didn't Just Simulate Chaos, We Mastered It. The "God Mode" console isn't a gimmick; it's the core of our thesis. We're proudest of the moment we triggered our first Wormhole and, instead of just crashing, the AI agents actively re-evaluated their paths, adapted, and survived. This proves our concept: we successfully built an AI that doesn't just react, but can actually handle a world that suddenly breaks all the rules.

It's an "Ecosystem," Not Just a Race. Our agents don't just drive in isolation. They have an Emotion Engine that affects their strategy, and they communicate with each other over the V2V Network. Seeing an "Aggressive" agent broadcast an "overtake" alert to a "Cautious" one—and seeing that agent react—was the moment we knew we had built more than a simulator. We built a living, digital ecosystem.

What we learned

Here is a "humanized" version of what you learned, based on your project details.

What We Learned Resilience is More Powerful Than Perfection We started by building an AI that could drive a perfect lap (our "Predictive Ghost"). But we quickly learned that perfection is useless in a chaotic world. The "best" AI wasn't the one with the fastest lap time; it was the one that survived a sudden wormhole or an EMP blast. We learned that true intelligence isn't about being perfect; it's about being adaptable.

"Personality" Is an Essential Feature, Not an Add-On We originally thought the "Emotion Engine" and "DNA" were just for show. We were wrong. They became the most critical part of our AI's brain. Without them, the agents were just identical, boring calculators. With them, the AI had to make real decisions: "Should I be aggressive and risk it all, or am I 'Exhausted' and should I play it safe?" We learned that to build a strategic AI, you first have to give it something to lose.

Real-Time AI is All About the Pipeline Having a live AI commentator sounds cool, but we learned it's a brutal engineering challenge. The 8-second window to capture game data, send it to Gemini, get a response, send that to ElevenLabs, and get the audio back without lagging the game was our toughest problem. We learned that the "magic" of real-time AI isn't just the AI model itself; it's in the lightning-fast, hyper-efficient pipeline you build to feed it.

Data Is Boring. Stories Are Immersive. We already had a dashboard with charts, stats, and leaderboards. It was full of data, but it was boring. The moment we turned on the live AI Commentator, the entire experience changed. It went from a data simulation to a story. The commentator gave context to the crashes and meaning to the overtakes. We learned that no matter how much data you show, it's the human-like story that makes people care.

What's next for AgniMotion

This is an excellent question. We see AgniMotion not just as a one-time project, but as the foundational platform for a much bigger vision.

Here’s what’s next:

True Multiplayer: You vs. The World (and the AI) Our absolute top priority is taking the simulation from "Human vs. AI" to "Human vs. Human vs. AI." We plan to build out the real-time multiplayer networking, allowing you to race live against friends while also competing with our evolving AI agents and navigating the "God Mode" chaos events.

Making it Real: AR/VR Integration We don't just want you to watch the race; we want you to be in it. The next major step is to integrate WebXR, allowing you to put on a headset and experience the neon-lit track and high-speed chaos from the driver's seat in full virtual reality.

Unleashing Creativity: The Custom Track Editor Why stick to our track? We're going to build a fully-featured, in-browser track editor. This will let users design their own complex, chaotic courses and share them with the community, creating an entirely new set of challenges for both human and AI racers.

Beyond the Game: Real-World Applications The long-term vision is to use AgniMotion as a serious research tool. We plan to start feeding the system with real-world telemetry data from actual autonomous vehicles. This will allow us to move from a simulated challenge to a true digital twin, creating a safe, high-speed environment to train the next generation of AI for real-world self-driving cars.

Built With

  • db
  • edge-functions
  • elevenlabs-api
  • framer-motion
  • google-gemini-api
  • react
  • react-three-fiber
  • realtime)
  • recharts
  • supabase-(auth
  • tailwind-css
  • three.js
  • typescript
  • vite
Share this project:

Updates

Submission history