RiddleMaster - AI Scavenger Hunt

Turn any room into an instant escape room! AI sees your space through the camera, generates riddles based on real objects, and validates answers with semantic reasoning. Zero setup required.

Comment

Inspiration

The hackathon brief was clear: build something beyond a chatbot. Current scavenger hunt apps like Goosechase require manual setup. What if AI could generate the entire experience instantly by seeing your actual environment?

RiddleMaster uses Gemini 3's Live API to turn any room into an escape room with zero preparation.

What it Does

  1. 📹 Point your camera at any space
  2. 🧠 AI analyzes objects in real-time
  3. ❓ Riddles generated dynamically ("Find something that holds memories but isn't a brain")
  4. ✅ Semantic verification using reasoning, not just object recognition
  5. 🎮 Game mechanics: streaks, hints, difficulty modes

How We Built It

  • Frontend: React 19 + TypeScript + Vite + TailwindCSS
  • AI Core: Gemini 3 Live API (video + audio streaming)
  • Audio: Web Audio API for voice processing

Challenges

  • Audio synchronization with buffer scheduling
  • Video streaming optimization (1 FPS, 50% scale)
  • Prompting AI for semantic riddles vs simple object detection

What We Learned

Gemini 3's Live API enables true real-time multimodal experiences that weren't possible before.

Built With

Share this project:

Updates

Submission history