🐾 Michelin — Collaborative Feline Clinical Co-Pilot

All Things Agentic Hackathon Submission

  • Track: The Collaborative Partner
  • Target Category: Healthcare & Veterinary AI / Autonomous Clinical Systems
  • Pilot Site: Clínica Veterinaria Aguascalientes, Mexico

📌 Elevator Pitch

Michelin is an intelligent, multimodal veterinary clinical co-pilot powered by Gemini and Google Cloud that collaborates with veterinarians and cat owners to prevent missed or delayed feline diagnoses. By fusing longitudinal health records, X-rays, lab panels, and owner symptom logs, Michelin actively asks clarifying diagnostic questions, formulates probabilistic differential diagnoses, and enforces strict false-negative safety guardrails for stealth feline conditions.


💖 Inspiration

Michelin is the love of my life. He suffered from a severe feline health issue that was not detected in time, leading to heartbreak that no pet parent or veterinarian should ever have to endure.

Cats are biologically hardwired to mask illness and pain until diseases reach advanced, irreversible stages. Subtle shifts—such as a dropping Albumin-to-Globulin (A:G) ratio, minor weight decline, or subtle changes in sleeping respiratory rate—are frequently overlooked during brief 15-minute consultations.

We created Michelin so that no cat or human has to go through this pain again, turning retrospective grief into proactive, life-saving clinical collaboration.


⚙️ What It Does

Michelin transforms veterinary diagnosis from static, isolated consultations into a continuous, collaborative clinical partnership:

  1. Longitudinal Patient Health Vault:
    • Aggregates and correlates multi-source health data: DICOM/radiographs, ultrasounds, CBC & chemistry panels, consultation SOAP notes, and real-time home logs from pet owners.
  2. Bidirectional Clinical Collaboration (The Collaborative Partner):
    • Rather than acting as a passive chatbot, Michelin actively leads diagnostic exploration. It asks veterinarians targeted, high-yield clarifying questions (e.g., "Did you notice paradoxical breathing or muffled heart sounds on auscultation?", "Has fluid viscosity been checked with a Rivalta test?").
  3. High-Sensitivity False-Negative Sentinel:
    • Specifically engineered to catch stealth feline killers (Feline Infectious Peritonitis [FIP], Hypertrophic Cardiomyopathy [HCM], and early Chronic Kidney Disease [CKD]). It flags discordant biomarkers (e.g. inverted A:G ratio < 0.45, elevated SDMA despite normal creatinine) before irreparable organ damage occurs.
  4. Live Probabilistic Differential Diagnosis Matrix:
    • Ranks differential diagnoses in real time, accompanied by concrete "Must-Rule-Out" tests and immediate therapeutic action protocols grounded in AAFP (American Association of Feline Practitioners) and WSAVA guidelines.

🏗️ How We Built It

Michelin is built on a state-of-the-art Google AI and Google Cloud foundation:

  • Google Gemini 2.5 / 3.5 Pro Multimodal: Performs high-fidelity reasoning across feline radiograph images, lab blood panels, and longitudinal clinical text.
  • Google Agent Development Framework & Antigravity Agent Runtime: Powers the collaborative agent loops, tool-calling interfaces, and bidirectional clinical inquiry.
  • Google Cloud Run: Serverless, autoscaling backend hosting our FastAPI microservices and static clinical UI with low latency and zero idle costs.
  • Google Cloud Firestore & Cloud Storage: Secure, HIPAA/enterprise-compliant storage for longitudinal patient histories, DICOM imaging, and lab reports.
  • Clinical Safety & Grounding Layer: Rule-based and semantic guardrails grounded in AAFP FIP Guidelines, IRIS Staging, and ACVIM Cardiomyopathy Consensus to eliminate diagnostic hallucinations and minimize false negatives.

🛡️ Challenges We Ran Into & Clinical Safety

Since the data directly concerns a feline patient's health and life, our highest engineering hurdle was eliminating false negatives:

  • The "Asymptomatic Illusion" Challenge: Early-stage feline diseases often present with nonspecific signs (mild lethargy, fluctuating low-grade fever). We built custom biomarker ratio detectors (such as A:G ratio inversion and weight-loss velocity tracking) that trigger proactive alerts even when standard reference ranges look deceptively "borderline".
  • Source Reliability & Grounding: We anchored every clinical suggestion and differential score to verified veterinary literature (AAFP, WSAVA, VIN) with explicit references displayed in the UI.

🏆 Accomplishments That We're Proud Of

  1. Real-World Deployment in Aguascalientes:
    • Partnered with a veterinary clinic in Aguascalientes, Mexico, piloting the system with real feline clinical records to validate usability and diagnostic speed.
  2. True Collaborative Partnership:
    • The agent doesn't just answer—it proactively guides veterinarians through complex diagnostic trees and actively integrates owner behavioral logs.
  3. Production-Ready Google Cloud Architecture:
    • Deployed on Google Cloud Run with complete Docker containerization and continuous deployment via Google Cloud Build.

🔬 What We Learned

  • Agentic Proactivity > Passive Search: Veterinarians don't need another search engine; they need a vigilant co-pilot that flags anomalies they might miss during a busy clinic shift.
  • Multimodal Fusion is Essential in Vet Medicine: Diagnostic truth in feline medicine rarely comes from a single test; it requires the synthesis of visual imaging (X-rays), numerical data (biomarkers), and owner behavioral observations over time.

🚀 What's Next for Michelin

  • Edge Ultrasound & POCUS Video Analysis: Expanding multimodal capabilities to ingest live point-of-care ultrasound (POCUS) video streams during examinations.
  • Continuous IoT Wearable Integration: Integrating smart cat collars and smart litter box sensors (monitoring daily weight, urination frequency, and sleep respiration rate) for automated longitudinal alerts.
  • Nationwide Veterinary Clinic Rollout: Expanding the pilot from Aguascalientes to veterinary hospitals across Mexico and Latin America.

Built With

  • agent
  • antigravity
  • build
  • cloud
  • css
  • development
  • fastapi
  • firestore
  • gemini
  • google
  • kit
  • pro
  • python
  • run
  • runtime
  • storage
  • tailwind
Share this project:

Updates

posted an update —

Major Milestone Update: End-to-End Multi-Agent Ecosystem Deployed with Non-Negotiable Medical Guardrails and Live 4-Minute Interactive Simulation

We are pleased to share a major milestone in the evolution of Michelin: Veterinary Multi-Agent Clinical Ecosystem for feline internal medicine.

We have officially built, tested, and deployed an end-to-end, production-ready prototype featuring a dual-agent collaborative architecture, an atomic Central Patient Store (SSOT), strict clinical guardrails, and a live web simulation.


What Is New in This Release

1. Collaborative Multi-Agent Architecture

  • "Michelin" (Veterinary Co-Pilot Agent — powered by Gemini 2.5 Pro): Collaborates directly with attending clinicians (Dr. Andy). Performs proactive clinical cross-examination, differential audits, and longitudinal lab trend analysis to prevent missed or delayed diagnoses.
  • "Haiiro" (Caregiver Triage Companion — powered by Gemini 2.5 Flash): Empathetic, low-latency companion for pet parents at home. Ingests symptoms and photos, triages clinical risk (RED / YELLOW / GREEN), enforces non-negotiable emergency rules, and automatically escalates to Dr. Andy when thresholds are breached.
  • Central Patient Store (SSOT): A unified, multimodal record with atomic version locking (record_version increment with conflict detection) that guarantees zero state drift between caregiver home logs and clinical charts.

2. Non-Negotiable Medical Guardrails

  • Zero Hallucination Protocol: The system never interpolates or extrapolates numeric lab values or missing clinical data. Every cited metric is verified against the SSOT; unverified numbers are automatically redacted ([UNVERIFIED-VALUE-REDACTED]).
  • Strict OCR Ambiguity Protocol: Any smudged, low-confidence, or blurred metric/image (such as Michelin's smudged platelet count "2?8") is forced to status: "AMBIGUOUS", value: null, with the mandatory clinical flag: "Data unreadable / ambiguous — manual clinical verification required".
  • Deep Feline Domain Nuance:
    • Longitudinal IRIS CKD Staging (2023): Catches creeping creatinine rising 1.4 -> 1.9 -> 2.3 mg/dL alongside inadequate urine specific gravity (1.022 < 1.035), staging the patient in IRIS Stage 2 CKD even when creatinine falls within standard laboratory reference intervals (0.6 - 2.4 mg/dL).
    • Feline Triaditis Pattern Recognition: Correlates pancreatic elevation (Spec fPL 6.8 ug/L), hepatobiliary changes (ALT 148 U/L), and chronic gastrointestinal weight loss.
    • Triage Downgrade Prevention: Deterministic feline emergency rules (breathing difficulty, male cat straining to urinate, 3+ vomiting episodes) can never be downgraded by the LLM.

3. Rigorous Test Suite

  • 44 automated test cases passing with 100% coverage across type-level Pydantic models, strict OCR parsing, zero-hallucination citation verification, IRIS staging, multi-agent workflows, and FastAPI endpoints.

Live Links and How to Experience It

Experience the live ecosystem directly in your browser without installing anything or paying any cost:

Resource Link Description
The 4-Minute Interactive Video Simulation https://michelin-veterinary-ai.onrender.com/demo Watch our 4-minute clinical walkthrough with synchronized split-screen views (Haiiro mobile triage + Michelin clinical co-pilot), live trend lines, and browser text-to-speech voiceover.
The Interactive API Explorer (Swagger UI) https://michelin-veterinary-ai.onrender.com/docs Test every endpoint live (triage observations, hypothesis cross-examination, and longitudinal trends).
Render https://michelin-veterinary-ai.onrender.com Production service running on Render Free tier with zero viewer cost.
Git hub https://github.com/nadiajim/michelin-veterinary-ai Full open-source codebase, test suite, and architectural documentation.

Quick Tour of the 4-Minute Simulation (/demo)

If you visit the demo link, you will see a 5-act journey through the real patient case of Michelin (10.5yo male DSH):

  1. Act 1 (0:00 - 0:45): The subtle creep of feline chronic kidney disease masked by standard lab reference limits.
  2. Act 2 (0:45 - 1:45): Haiiro in action at home, handling a low-light blurry vomit photo with strict ambiguity guardrails and triggering a YELLOW emergency escalation.
  3. Act 3 (1:45 - 2:30): Central Patient Store (SSOT) synchronizing data atomically (v7 -> v8).
  4. Act 4 (2:30 - 3:30): Michelin Co-Pilot challenging Dr. Andy's gastritis hypothesis and flagging concurrent Triaditis.
  5. Act 5 (3:30 - 4:00): Medical guardrail telemetry and zero hallucination guarantee.

We welcome feedback and invite you to explore the live simulation and API endpoints.

Log in or sign up for Devpost to join the conversation.

posted an update —

Help Test Michelin’s Custom Gem!

AllThingsAgenticHackathon (The Collaborative Partner Track)!

Michelin is an intelligent, multimodal veterinary co-pilot built on Google Gemini and deployed on Google Cloud Run to tackle a critical challenge: delayed and missed feline diagnoses.

Alongside the core platform, I created an interactive Gemini Gem designed to simulate the co-pilot experience. It’s an early-stage tool, and I need your eyes on it. Whether you are a veterinarian, an AI enthusiast, or a cat parent, your feedback will directly guide the next iteration.

Test the Michelin Gem here: https://gemini.google.com/gem/1Dr3W62PdC-dWbe0ov1jBuAMOrVsYORlD?usp=sharing

Drop your thoughts in the comments or send a DM—what would you add, refine, or test next?

AllThingsAgenticHackathon #GoogleCloud #GeminiAI #VeterinaryMedicine #ArtificialIntelligence #CloudRun #HealthTech #MachineLearning #VetTech

Log in or sign up for Devpost to join the conversation.

Submission history