Inspiration

Home insurance is broken for the average consumer. Most people have no idea why their premium is what it is, what risks their home actually faces, or what they could do to lower their rate. The process is opaque, jargon-heavy, and completely inaccessible to people who need it most.

We wanted to fix that. The idea was simple: give homeowners the same data insurance underwriters use and let them actually understand it by delivering a clear results page that breaks down every factor raising or lowering their score, paired with actionable goals they can complete to improve it over time.

But the real inspiration behind Agent Jake was inclusivity. Whether you have a visual impairment, a motor disability, or simply find dense forms overwhelming, Agent Jake meets you where you are. No menus to click through, no long paragraphs to read. Just talk, and Jake handles the rest. It allows you to hold that conversation in whatever language feels most natural to you, removing the language barrier that has historically kept non-English speaking homeowners from fully understanding their coverage and their risk.

Understanding your home's risk shouldn't take up your time or require you to speak the language of insurance. It should take three minutes and a voice. That's Agent Jake. Your good neighbor that now listens.

What it does

AgentJake is a fully voice-driven AI home insurance risk advisor. You simply speak your address and Agent Jake — powered by ElevenLabs conversational AI — instantly pulls real data about your property from multiple sources simultaneously:

  • FEMA — flood zone designation for your exact address
  • Google Maps — nearest fire station and driving distance
  • National Weather Service — active weather alerts for your location
  • ATTOM Data — property details including year built, square footage, and bedrooms
  • US Census Bureau — neighborhood housing age data
  • FBI Crime Data — property crime rates for your area
  • USGS — wildfire hazard potential

Once your property is loaded, you can ask Agent Jake anything — "Am I in a flood zone?", "How far is the nearest fire station?", "What's my square footage?" — and he answers instantly from real data. The agent then walks you through 7 risk questions by voice, builds a complete risk profile, and generates a personalized risk score with actionable recommendations powered by Gemini AI.

How we built it

We built Agent Jake using Python and FastAPI on the backend, React and Vite on the frontend, and ElevenLabs to power the voice agent. When a user speaks their address, 8 APIs fire at the same time pulling real data from FEMA, Google Maps, National Weather Service, ATTOM, the US Census Bureau, FBI Crime Data, and USGS. Everything gets stored in SQLite and fed into Gemini AI to generate the final risk score.

Challenges we ran into

The biggest challenge was getting the frontend and backend to actually talk to each other. We built both sides separately and merging them took more time than building either one alone. ElevenLabs was also completely new to us and getting the voice agent to pick up and respond with live data was a real learning curve.

Accomplishments that we're proud of

We are proud of how the voice experience came together with ElevenLabs, the conversation feels natural and accessible in a way that makes the product genuinely usable for anyone. Our backend is something the whole team is proud of too, getting 8 APIs working in parallel and returning real verified data on any US address in seconds. And watching Gemini take all of that raw property data and turn it into a clear personalized risk summary that actually makes sense to a real homeowner.

What we learned

We learned that there is a free or low cost API for almost anything you can imagine and knowing how to find and use them is a skill in itself. We also learned a lot about ElevenLabs specifically, how conversational AI agents work under the hood, how to wire client tools to live data, and how to debug when the voice agent is not behaving the way you expect.

What's next for AgentJake

We want to add a basic chat interface alongside the voice agent so users can follow up with typed questions and get deeper insights. We also want to expand AgentJake beyond home insurance into auto and life insurance, same idea, same voice-first approach, broader coverage. And we want to connect to real carrier APIs so AgentJake can eventually show live quote comparisons based on your actual risk profile.

Built With

Share this project:

Updates