EarthWhisper

Inspiration

Discovering new places usually means maps, clicks, and screens. I wanted something more natural — like talking to a guide while exploring the Earth. The idea came from imagining a world where you don’t need your hands at all, where you can just ask questions and move around the planet using your voice, the same way you would talk to a person.

That’s how EarthWhisper was born: learning about places by conversation, not by menus.

What it does

EarthWhisper lets users explore the planet hands-free using voice. You can ask about countries, cities, landmarks, cultures, or geography facts, and the app responds instantly while moving the globe for you.

You don’t click or type — you speak. The planet reacts to your voice, making learning feel more like a conversation than a lesson.

How we built it

We built EarthWhisper using:

• ElevenLabs voice agents for natural, human-like voice interaction
• Gemini AI to understand questions and generate accurate, contextual responses
• MediaPipe with TensorFlow to handle motion and interaction logic without relying on hands or touch

The system listens, understands intent, responds with voice, and updates the planet view smoothly based on what the user asks.

Challenges we ran into

A challenge was syncing voice responses with planet movement in a way that felt smooth and intuitive, not confusing or overwhelming.

Accomplishments that we're proud of

• Creating a fully hands-free geography learning experience
• Making planet exploration feel conversational instead of technical
• Successfully combining voice, AI, and motion into one smooth flow
• Building something that feels accessible even for non-technical users

What we learned

We learned that voice-first design changes everything. You have to think less like a developer and more like a guide or teacher.

We also learned that simplicity matters more than features — if the interaction feels natural, users stay engaged longer and learn more.

What's next for EarthWhisper

Next, we want to add:

• Personalized learning paths based on user interests
• Deeper cultural and historical storytelling
• Multi-language support for global users
• More immersive planet interactions and guided tours

Our goal is to make EarthWhisper feel like the smartest, friendliest geography guide you’ve ever talked to.

Built With

• elevenlabs