Unveiling the Augmented Reality Marvel: 'Waldo AR' 🌐🔍✨

Inspiration 🌈

In the ever-evolving landscape of augmented reality (AR), our team found inspiration in revitalizing a classic – the timeless joy of the 'Where's Waldo?' hunt. The idea was not merely to recreate the familiar game but to elevate it into an immersive experience that seamlessly blends the virtual and physical worlds.

What it does 🎮

Welcome to 'Waldo AR,' your passport to a geospatial adventure where the hunt for Waldo becomes a dynamic journey. The game leverages the powerful combination of Google's ARCore, Unity's Geospatial Creator, and Google Cloud services, including Text-to-Speech (TTS) and Speech-to-Text (STT), to allow players to choose real-world locations as their gaming canvas.

How we built it 🛠️

The backbone of 'Waldo AR' is the Geospatial Creator in Unity, a tool that bridges the gap between the virtual and physical realms. Through this integration, users can select their play zones, transforming familiar landscapes into the backdrop for their augmented reality escapades.

Privacy First: AR and Microphone Usage

Before the adventure begins, we prioritize your privacy. 'Waldo AR' features a privacy screen at the start, presenting AR privacy and microphone usage disclaimers. This ensures transparency and establishes a trustful environment for your augmented reality experience.

Automatic Interaction with Civilians

As you venture into the augmented world, the game automatically engages your device's microphone when you approach a virtual civilian. Utilizing Google Cloud Speech-to-Text, your conversations with characters are seamlessly transcribed in real-time. This feature not only adds a layer of realism but also enhances your engagement with the characters, making your journey more immersive.

Placing Civilians and Customization 🧑‍🎨

Once a location is chosen, the Geospatial Creator facilitates the placement of virtual civilians, each with a role intricately tied to their surroundings. The customization options go beyond aesthetics, allowing users to fine-tune voices, accents, and appearances. Google Cloud Text-to-Speech steps in to bring these characters to life with diverse and authentic vocal expressions.

AI Prompts and Waldo's Challenge 🕵️‍♂️

The magic unfolds with AI prompts – each civilian drops hints about Waldo's location, turning the search into a dynamic, mind-bending challenge. The Geospatial Creator plays a pivotal role in hiding Waldo strategically, and Google Cloud Speech-to-Text transcribes and processes the hints, ensuring a seamless and interactive gaming experience.

Mini Games, Powerups, and Golf Challenge ⛳

The Geospatial Creator's versatility extends to mini-games, powerups strategically placed in the map, and even a golf challenge. These elements not only enhance gameplay but showcase the application's visual quality, thanks to Photorealistic 3D Tiles integrated seamlessly.

Challenges we ran into 🚧

Integrating Geospatial Creator in Unity posed its set of challenges, particularly in ensuring a smooth and responsive experience across different devices and locations. Fine-tuning the AI prompts, balancing the game's difficulty, and integrating Google Cloud services were also intricacies that demanded attention.

Accomplishments that we're proud of 🏆

One of the standout achievements of 'Waldo AR' lies in successfully leveraging Geospatial Creator and Google Cloud services to provide users with a personalized, location-specific gaming experience. The dynamic integration of ARCore technologies for hiding Waldo, coupled with TTS and STT, showcases a seamless blend of creativity and technical prowess.

What we learned 📚

Through the development of 'Waldo AR,' our team delved deep into the capabilities of Geospatial Creator in Unity and the seamless integration of Google Cloud services. We learned to harness their potential to create engaging, location-aware experiences that transcend traditional gaming boundaries. The nuanced customization, dynamic interactions, and the interplay of AI with the real world have broadened our understanding of augmented reality design.

What's next for 'Waldo AR' 🚀

The journey doesn't end here. 'Waldo AR' is just the beginning of a new era in geospatial gaming. We plan to enhance localization features, incorporating more cultural elements, refining the integration of Geospatial Creator, and exploring further possibilities with Google Cloud services. Additionally, we aim to expand the range of playable locations, ensuring 'Waldo AR' becomes a global phenomenon that brings joy to AR enthusiasts everywhere.

In the fast-evolving landscape of augmented reality, 'Waldo AR' stands as a testament to the exciting possibilities when cutting-edge technology meets classic entertainment. Let the search for Waldo in your world begin! 🌍👀✨

Built With

• arcore
• c#
• geospatial
• google-cloud
• unity