QuestAR

Treasure chest
Riddle popup in AR
AR Quest path
Rock paper scissor mini game
Rock paper scissor mini game
Destination or quest check point

Updated presentation link (pdf) :https://drive.google.com/file/d/16pAyMFpnx7uCXmhmTdC_mVzLxhzirqGm/view?usp=sharing

🧠 Inspiration

We wanted to create a game that makes people physically active, socially engaged, and intellectually curious — all at the same time. Inspired by Pokémon Go, scavenger hunts, and real-time multiplayer games, we aimed to merge AR, education, and movement into a single platform.

🎮 What it does

QuestAR is a multiplayer AR treasure hunt where players explore real-world locations to find hidden clues, solve AI-generated riddles based on landmarks, and challenge other players in mini-games like “Steal the Reel” (rock-paper-scissors using computer vision). The game encourages learning through play, tracks user stats live in MongoDB, and promotes movement and discovery.

🛠️ How we built it • Frontend: Web-based AR using JavaScript, AR.js, and Three.js • Backend: Node.js + MongoDB with Socket.io for real-time sync • AI: Gemini API generates riddles based on live location metadata • Computer Vision: TensorFlow.js and MediaPipe for gesture recognition in mini-games • Hosting: Local network (for now) with plans to move to the cloud

🧱 Challenges we ran into • Achieving real-time performance on mobile web AR • GPS drift and AR marker stability outdoors • Handling gesture recognition accuracy across lighting conditions • Coordinating multi-player state and data sync with WebSockets • Formatting meaningful AI-generated riddles dynamically per location

🏆 Accomplishments that we’re proud of • Built a fully working AR treasure hunt with real-time multiplayer • Created a gesture-based mini-game entirely on the web • Integrated live AI riddle generation using the Gemini model • Encouraged real-world exploration, movement, and learning through fun!

📚 What we learned • The power of combining AR + AI + CV + Multiplayer in one app • Practical deployment of computer vision in browsers • How to structure real-time multiplayer logic with fail-safe design • Tuning generative AI prompts for location-based riddles • Designing intuitive UX for outdoor AR adventures

🚀 What’s next for QuestAR • Host on the cloud for public multiplayer access • Add more mini-games and theme-based treasure hunts • Allow user-generated quests for educators or event organizers • Improve AR visuals with animations, 3D models, and avatars • Launch seasonal hunts for schools, tourism boards, and festivals