MinuteZero

A real-time, multimodal AI First Responder that eliminates the "Panic Gap" in life-threatening emergencies using Gemini 1.5 Pro.

Comment

🏥 MinuteZero: Closing the "Panic Gap"

"In a heartbeat, the world stops. Help is minutes away. Every second counts. This is the Panic Gap."

⚡ The Inspiration

In a medical emergency, you don't have minutes—you have seconds. We call this the "Panic Gap"—the void where fear paralyzes bystanders and professional help is too far away. We were inspired by a single question: What if the smartphone in your pocket could become a world-class ER specialist in the palm of your hand?

👁️ What it does: See. Hear. Save.

MinuteZero is a real-time, multimodal AI First Responder. Unlike traditional chatbots, MinuteZero sees the injury, hears the environment, and acts with zero-latency.

  • 🩸 Multimodal Wound Vision: Powered by Gemini 1.5 Pro, our agent identifies specific clinical markers (like Brachial vs. Femoral bleeds) and estimates blood loss volume via live video.
  • 🧒 Life-Saving Maneuvers: Using the Multimodal Live API, MZ detects body posture through the lens to guide you through a precise Heimlich maneuver or arterial occlusion—correcting your technique as you go.
  • 🩺 Clinical Briefing Sync: At the session's end, the agent uses the ADK (Agent Development Kit) to synthesize a high-fidelity medical handover and syncs it across Google Drive, GCS, and Firestore.
  • ⏱️ The 14-Minute Edge: By pre-routing patients to specialized trauma bays using the Google Maps Places API, we eliminate intake overhead, saving up to 14 critical minutes.

🛠️ How we built it: The Zero-Latency Core

1. Built with the Agent Development Kit (ADK) ✅

MinuteZero is a "Google-native" agent built using the official Vertex AI Agent Development Kit (ADK).

  • Core Reasoning: We implemented a specialized MinuteZeroClinicalAgent that lives in resq-agent/adk_compliance.py. This agent orchestrates high-stakes medical reasoning by processing interleaved vision and audio markers.
  • Framework: Developed using the Vertex AI SDK for Python, ensuring our agent patterns follow Google's best practices for autonomous reasoning.

2. Built with the Gemini Multimodal Live API ✅

The heart of our real-time interaction (zero-latency voice and vision) is powered by the Gemini 1.5 Pro Multimodal Live API.

  • Orphestration: We used the official LiveKit-Google plugins to manage ultra-low latency WebRTC streams, allowing users to interrupt the agent naturally during crisis.

3. Built with the Gemini GenAI SDK ✅

We leverage the official google-generativeai SDK for post-session high-fidelity clinical synthesis. This ensures that every life-saving tip provided during the "Golden Minute" is archived as a production-ready medical record.

4. Extensive use of Google Cloud Services ✅

MinuteZero is deeply integrated into the GCP infrastructure to provide production-grade reliability:

  • Google Cloud Vertex AI: Hosts our ADK-based medical reasoning unit and Gemini 1.5 Pro models.
  • Google Cloud Firestore: Provides real-time synchronization of session diagnostics and patient state tracking for hospital staff.
  • Google Maps Places API (GCP): Powering Specialized Medical Routing. MZ automatically identifies and navigates to the nearest relevant facility (e.g., Level 1 Trauma Center vs. Pediatric ER).
  • Google Cloud Storage (GCS): Securely archives HIPAA-compliant clinical briefings.
  • Google Cloud Run: The backend agent is containerized and deployed on Google Cloud's serverless platform for instant global scaling.

🌊 Challenges & Breakthroughs

Bridging the "Panic Gap" meant we could not tolerate even 100ms of latency. Our biggest breakthrough was using the ADK to build a "Medically Aware" state machine that could prioritize instructions over fluff. Seeing an AI not only identify a bleed but also tell the hospital staff to "Prep Trauma Bay 4 and O-Negative blood" transforms the phone into a mission-critical medical instrument.

🌈 Accomplishments we're proud of

We’ve turned a generative model into an Active First Responder. MinuteZero doesn't just "chat"; it performs clinical analysis, searches for Level 1 trauma centers, and prepares a trauma ward via real-time GCP synchronization. We’ve extended the "Golden Minute" from the street corner directly into the hospital ward.

🎯 What's next for MinuteZero

We are looking toward Wearable Integration. Imagine MinuteZero seeing through your AR glasses and feeling through your heart-rate monitor. We are building for a world where nobody has to face the "Panic Gap" alone.

Build for the Gemini Live Agent Challenge | 2026

Built With

  • agent-development-process
  • agent-developmet-kit
  • gemini-1.5-pro-(multimodal-live-api)
  • google-cloud
  • google-cloud-firestone
  • google-cloud-run
  • google-drive-api
  • google-search-function-calling
  • livekit-cloud-(webrtc)
  • lucide-icons
  • next.js-14
  • tailwindcss
  • vertex-ai
Share this project:

Updates