✨ Project Narrative & Technical Journey
🎯 Inspiration
At the heart of this project lies a simple yet powerful idea:
what if games truly listened?
- A clear motivation to build a voice-first gaming experience, not an afterthought UI wrapper.
- The concept of a mystical AI Orb as a living presence — one that narrates, listens, reasons, and judges.
- Solving a core problem: enabling natural detective work through speech, deduction, and constrained reasoning rather than menus and clicks.
📚 What We Learned
This project pushed us far beyond basic API usage into real engineering depth:
- 🎙️ Voice AI Mastery
Deep integration of ElevenLabs for cinematic narration and dynamic AI responses. - 🧠 AI Conversation Design
Advanced prompt engineering, guardrails, and controlled reasoning using Gemini. - 🏗️ Production-Grade Thinking
Secure API handling, server-side orchestration, and scalable architecture decisions.
🔧 How We Built It
A carefully engineered pipeline powers the experience:
- 📐 Detailed architecture diagrams outlining frontend, backend, and AI orchestration.
- 🧰 A modern core technology stack optimized for latency and reliability.
- 🧩 Key implementation snippets demonstrating clean API usage.
- 🔄 A complete voice pipeline flow:
Speech → Text → Reasoning → Text → Voice
💪 Challenges Faced
Real problems. Real solutions.
- Complex API orchestration across voice, reasoning, and UI layers
- Real-time audio processing without overlap or latency artifacts
- Balancing gameplay with AI intelligence (no spoilers, no cheating)
- Cross-platform voice support and fallback handling
- Production-level security for keys, data, and user flow
- Performance optimization, supported by mathematical modeling and benchmarks
We didn’t hide complexity — we embraced it.
🏆 Technical Achievements
Engineering depth that goes beyond demos:
- 📊 Measured performance metrics with real numbers (latency, response time, throughput)
- 📐 Mathematical formulations for optimization and AI response timing (LaTeX-based where applicable)
- 💡 Clear innovation highlights in voice-driven interaction and constrained AI reasoning
🚀 Future Vision
This is just the beginning.
- ♿ Expanding accessibility through voice-first gameplay
- 🗺️ A clear roadmap for richer narratives, adaptive difficulty, and multiplayer modes
- 🎓 Strong potential for educational applications in logic, debate, and critical thinking
🎯 Key Strengths at a Glance
- Technical Depth — Real engineering challenges with real solutions
- Mathematical Rigor — Optimization backed by formulas, not guesses
- Production Focus — Security, performance, and reliability first
- Innovation Story — A clear narrative of pushing voice-AI boundaries
- Future Vision — Scalable, impactful, and adaptable beyond gaming
This project is not just a game — it’s a demonstration of what voice-first AI experiences can become.
Built With
- agile-development
- api-key-management-performance:-code-splitting
- app-engine
- arraybuffer-security:-environment-variables
- audiocontext
- autoprefixer
- base64
- blob-api
- brotli-testing-&-qa:-typescript-checks
- browser-devtools
- bundle-optimization
- canvas-api
- cloud-build
- cloud-storage
- content-security-policy
- continuous-integration
- conventional-commits-apis:-rest-apis
- cors
- cross-browser-testing-version-control:-git
- css-grid
- css-transforms
- css3
- elevenlabs-streaming-api
- elevenlabs-tts
- elevenlabs-voice-cloning
- elevenlabs-websocket-api-audio-&-speech:-web-speech-api
- embla-carousel
- error-handling-browser-tech:-pwa
- eslint
- eslint-rules
- flexbox-state-&-data:-react-context
- framer-motion
- github
- github-actions-dev-tools:-node.js
- glsl-frontend:-react-18
- google-vertex-ai
- gsap
- gzip
- html5
- https/tls
- indexeddb
- javascript-(es2022)
- keyboard-events
- lazy-loading
- lighthouse
- localstorage
- lucide-react
- markdown
- media-queries-methodologies:-component-driven-development
- mediarecorder-api
- npm
- ogl-ai-&-voice:-google-gemini-2.5-flash-lite
- postcss
- prettier
- rate-limiting
- react-hook-form
- react-hooks
- react-query
- react-resizable-panels
- react-router
- recharts
- responsive-design
- service-workers
- session-storage-audio-processing:-mp3
- shadcn/ui
- sonner
- speech-recognition
- speech-synthesis-cloud-&-deployment:-google-cloud-platform
- streaming-apis
- tailwind-css
- test-driven-development
- touch-events
- tree-shaking
- typescript-compiler-ui/ux:-radix-ui
- vaul-graphics:-three.js
- vercel
- vite
- wav
- web-audio-api
- webgl-2.0
- websocket-apis
- zod
Log in or sign up for Devpost to join the conversation.