Inspiration

Ever wondered what life is like for a mischievous, treasure-hunting raccoon? We wanted to capture that chaotic, curious energy in an app that turns everyday objects into valuable loot. Inspired by raccoons' love for shiny things (and their talent for rummaging through trash), Raccoon Raider transforms the simple act of scanning objects into a playful pirate adventure.

But it’s not just about what you find—it’s about what everyone finds. We wanted to create a shared scavenger hunt, where players can see what others have discovered in their city, turning the app into a living, digital treasure map. Like raccoons leaving trails of their nightly escapades, users can log their finds and piece together a community-driven diary of urban exploration. Whether it’s a weird sticker on a street pole, a forgotten relic on the sidewalk, or an oddly shaped rock that just feels important, Raccoon Raider makes the small things feel exciting—and connects you to the people who notice them too.

What it does

  • Uses Google Vision API to analyze objects from a photo
  • Uses Gemini AI to generate a raccoon pirate-style response about the item’s "value"
  • Allows users to save scanned loot along with its location in a treasure log map
  • Features a dynamic raccoon character that interacts with the user

How we built it

  • Frontend: Built with React Native & Expo
  • AI Integration: Used Gemini API to generate quirky raccoon-themed responses
  • Image Processing: Used Google Vision API to analyze photos
  • Cloud Storage: Used Firebase Firestore to save scanned items & user data
  • Geolocation: Integrated Expo Location to tag treasures with their real-world location

Challenges we ran into

We ran into a few challenges while building Raccoon Raider. Getting the Google Vision API and Gemini AI to work together smoothly took some time, especially making sure the AI responses actually felt like a mischievous raccoon pirate instead of a boring chatbot.

Accomplishments that we're proud of

Despite these challenges, we successfully blended AI, image recognition, and location tracking into a fun and engaging experience. We created a lively raccoon companion that reacts dynamically to user input, making interactions feel more immersive!

What we learned

We learned how to build a chatbox using Google Gemini and integrate it seamlessly into our app. We also gained experience in handling image processing with Google Vision API and implementing location tracking using Expo Location. Additionally, we explored ways to make AI-generated text feel more fun and engaging for users. Throughout the process, we refined our understanding of mobile UI design, animations, and responsiveness to create a smoother and more interactive experience.

What's next for Raccoon Raider

Raccoon Raider is just getting started! We plan to add a Loot Inventory so players can track and categorize their finds, turning their scans into a personal collection of treasures. To keep the adventure going, we’re introducing Daily Treasure Hunts, where users can scan specific items to uncover “legendary loot.” We also want to give our raccoon guide even more personality by enhancing its AI-generated responses to reflect different moods and reactions. A Treasure Map feature is in the plans, allowing players to see where they and others have discovered loot, making urban exploration even more interactive. Lastly, we plan on expanding our AI’s capabilities to provide historical insights and fun facts about scanned objects, adding an extra layer of discovery to every scan.

Share this project:

Updates