Inspiration

The movie Big Hero 6. I come from a flood prone zone and my house usually gets drowned and usually it takes lot of time for help like electricity is out, mobile signals are out and zone is quite remote. Less contact so I have seen drones help out by a manual operator.

What it does

It scans the places as a first responder and sends info to the necessary people such as ER, Firefighters, Police etc. It also talks to people who are in trouble and lets them know help is on the way

How we built it

We used a custom local mcp server that can take pictures and analzye images using anthropic and Vapi as the voice agent to give commands and also send for help. Google maps and twitter are integrated for public to know what is happening. Google docs as DB to store the transcripts of different people indivdually. Composio helped to create quick mcp servers of multiple other softwares

Challenges we ran into

Not enough Time to build, MCP is a new Concept. Camera hardware was faulty and had to be rewinstalled multiple times. Not enough emergency responder mcps

Accomplishments that we're proud of

I was able to take an image, analzye it and describe it while also pushing it to twitter with the location and also use voice agents

What we learned

What's next for First Responder Bot

Create a navigation stack with a drone and try to make it more production ready while also make it better

Built With

  • anthropic
  • claude
  • composio
  • mcp
  • python
  • vapi
Share this project:

Updates