GeminiAtlas

Snap Spectacles + Gemini AI that turns your environment into a live early-warning and learning atlas. Look up, capture, share, and stay safe.

Comment

Project Presentation

GeminiAtlas is a community early warning and education system built on Snap Spectacles and Gemini AI. In the Horn of Africa, resilience starts with understanding the land: recognizing stormy skies, identifying crops at risk, and knowing your environment. Today, information arrives too late. We turn every citizen into both a sensor and a learner. The user points at the sky, a book, or an everyday object. Gemini analyzes it and turns it into a geolocated knowledge card. These "Curiosity Cards" build a collective memory of the territory, shared with the community and ICPAC to better anticipate risks.

Solution Details

The app works in 3 steps. 1. Capture: A two-hand gesture isolates an object. Sky for constellations and weather, book for local knowledge, object for science. 2. Analysis: The image goes through Snap RSG to Gemini Live + OpenAI Vision, which provides context and explanations in 2 seconds. 3. Memory: Each card is geolocated on "The Globe," a 3D map. Turn your head to see knowledge from your region. Multiplayer mode lets 2 people review together with an AI-generated quiz. Works offline and syncs when the network returns.

How We Built It

Lens Studio + Snap RSG for processing. Gemini Live for the voice assistant. OpenAI Vision + GPT-4o for image analysis and question generation. global.* singletons for coordination. SpectaclesSyncKit for multiplayer.

Challenges We Ran Into

RSG only allows one Gemini session. We queued all requests. The microphone can lock up, so we added auto-restart. Device clocks differ, so we use server time for timestamps.

Accomplishments We're Proud Of

We turned Spectacles into a field learning tool. Globe-to-card navigation is smooth. Image detection runs in 2 seconds. The multiplayer quiz system is latency-tolerant.

What We Learned

Decouple logic from voice. Cache what never changes. Use card ID for stable placement on the Globe.

What's Next for GeminiAtlas

Deploy in more cities across East Africa. Add "Weather and Risk" modules: clouds, crops, water. Connect data directly to ICPAC and local NGOs. Long term: a citizen atlas where every street corner teaches and protects.

Built With

Share this project:

Updates