Inspiration:
The inspiration for XR Whack-a-Mole B19 came from the desire to blend physical interaction with virtual elements, transforming a familiar childhood game into an immersive XR experience. By tracking a real-world red balloon and integrating AI-based computer vision, the project explores how tangible objects can become interactive game tools within XR environments.
What we learned:
Working on this project demonstrated the unique power of XR to gamify physical movement and AI to reliably track objects in real time. Integrating OpenCV with Unity XR taught us how to solve technical challenges such as object detection under varied lighting and backgrounds, ensuring the red balloon is tracked accurately.
Challenges faced:
The major challenges were optimizing object tracking performance, reducing false detections, and synchronizing physical and virtual objects. Making the interaction intuitive and responsive involved multiple iterations of calibration and real-world testing.
Log in or sign up for Devpost to join the conversation.