Aura Games - AI Hand-Tracking Console

The Vision: Gaming hardware is expensive and restrictive. I wanted to democratize interactive gaming by turning any standard webcam into a high-speed motion controller.The Execution (How I built it): I engineered a massive web application housing over 50 unique game environments using an AI-assisted vibe coding workflow via Base44. This wasn't just about building simple UI; it required intense optimization of computer vision models to run seamlessly in the browser. To hit the NextGen Hacks criteria for 'Technical Execution & Creativity', I implemented:Advanced Computer Vision: Integrated MediaPipe Hands for real-time, low-latency landmark tracking to recognize complex gestures (pinching, swiping, waving, and multi-finger tracking). Massive Game Scale: Built 50+ unique physics and logic loops, ranging from classic arcades like 'Space Shooter' (with custom heart/lives systems) to advanced mechanics like 'Air Writing' (using OpenCV/MediaPipe for stroke-to-character recognition). AI Performance Coach: Developed an integrated AI system that actively analyzes player performance, gesture accuracy, and timing to provide real-time voice feedback (in both English and Hindi). High-Fidelity UI: Used React, Tailwind CSS, and Framer Motion to create a highly responsive, cinematic frontend that handles constant state changes without dropping frames. The Impact:Aura Games proves that the future of interactive entertainment doesn't require expensive VR headsets or controllers. It's accessible, highly scalable, and pushes the limits of what browser-based AI can achieve.

What it does

How we built it

Challenges we ran into

Accomplishments that we're proud of

What we learned

What's next for Aura Games - AI Hand-Tracking Console

Built With

• api
• base44
• framermotion
• mediapipe
• react
• speech
• tailwindcss
• web