Heali v1.0 -- Submitted for the Gemini Live Agent Challenge
What started as a personal problem -- worrying about my parents managing their medications alone in India -- is now a fully deployed, voice-first AI health companion.
What Heali can do today:
Voice Guardian -- Speak naturally to log medications, report vitals, and get real-time health guidance. Powered by Gemini Live API's native bidirectional audio streaming. No forms, no typing.
Prescription & Lab Report Reader -- Hold a handwritten prescription to the camera. Gemini 2.5 Flash extracts medications, checks drug interactions, and adds them to the schedule automatically.
Emergency Detection (Red Line Protocol) -- A deterministic safety system that detects critical symptoms like chest pain in 4 languages (EN/HI/KN/ES) and instantly triggers Twilio calls + Firebase alerts to family members. No AI guesswork -- hardcoded safety.
Exercise Coach -- Guided breathing and stretching sessions with real-time posture feedback through the camera.
Medical Translator -- Translates prescriptions and medical terms into the patient's native language.
Family Dashboard -- Caregivers see adherence scores, vitals, daily digest, and emergency alerts in real time from anywhere in the world.
Multilingual -- Kannada, Hindi, Spanish, English -- because healthcare shouldn't have a language barrier.
Tech Stack
Gemini Live API Google ADK (6 agents) Cloud Run Firestore Firebase Auth + FCM Twilio Voice FastAPI React 18 TypeScript
Links
- Live demo: medlive-zjp5lygwpa-uc.a.run.app
- GitHub: github.com/Abi5678/Heali-Your-AI-bestie
Built by Abishek Muralikrishna, Darsana Thulasi, and Rishika Mini Thulasi.
Because no parent should face their health alone, and no child should have to choose between their future and their family.
Log in or sign up for Devpost to join the conversation.