Inspiration

We were inspired by the need for both knowledge and companionship during travel, the yearning for getting to know an area and its history but not knowing where to start.

What it does

Our lens presents the user with a virtual agent, a flightless bird with a jetpack that gives them the gift of flight - Booster. Booster is meant to function as a tour guide for users, recognizing where the user is through computer vision and generating information about the history of the place or landmark they're near. You can even ask booster to show you an intractable 3D model of the local landmark!

How we built it

We utilized Snap Cloud powered by Supabase to create tables and store 3D models to be fetched during runtime of the lens and keep it light and under the file size specifications. Our agent Supabase is informed and trained by the data in these tables, and every feather of theirs was modeled with care!

Challenges we ran into

We honestly had an extremely smooth build, we had some issues integrating the rigged and animated model into the specs environment but once we smoothed out the missing behavior script it all clicked!

Accomplishments that we're proud of

We're so happy with the fact that all of the features we utilized meshed together so seamlessly and functioned well when pushed to the spectacles

What we learned

We learned a ton about integrating back end infrastructure into a lens and training agentic virtual assistants to help with our everyday lives. It's been so nice working within each others strengths and helping out with knowledge gaps as we all moved forward together.

What's next for Booster's Jetpack Tours Inc.

We would love to go deeper with integrations and APIs to expand the knowledge bass of our assistant. Being able to assist users with way finding, do semantic object recognition and also pull information like business hours, etc, really anything that a real tour guide would be able to do! Prepping this to be extremely user friendly for the release of consumer basing Spectacles in 2026 is top of mind

Built With

Share this project:

Updates