Inspiration

With an aging population (by 2030 all baby boomers will be 65+) and a caregiver shortage (1 in 5 provide unpaid care to family member), families and care facilities are struggling to keep up, placing increasing pressure on loved ones and the healthcare system.

What it does

Our video+voice agent socially engages patients while seamlessly connecting them to healthcare resources for triage, appointments, and medication refills—bridging the care gap.

How we built it

Patient (Voice/Video) <> Care Agent (Voice/Video) <> Coordinator Agent (Voice) <> Healthcare Provider (Phone Call)

Backend: python, flask, gemini api, Weave for logging Front end: vue.js, JavaScript, HeyGen avatar/TTS, HappyRobot voice calls LLM: Gemini

Challenges we ran into

Latency with LLM Gemini 1.5 pro generate decent results but too slow Coordinating multimodality outputs Prompt engineering to achieve advanced reasoning

Built With

Share this project:

Updates

Submission history