Inspiration
With an aging population (by 2030 all baby boomers will be 65+) and a caregiver shortage (1 in 5 provide unpaid care to family member), families and care facilities are struggling to keep up, placing increasing pressure on loved ones and the healthcare system.
What it does
Our video+voice agent socially engages patients while seamlessly connecting them to healthcare resources for triage, appointments, and medication refills—bridging the care gap.
How we built it
Patient (Voice/Video) <> Care Agent (Voice/Video) <> Coordinator Agent (Voice) <> Healthcare Provider (Phone Call)
Backend: python, flask, gemini api, Weave for logging Front end: vue.js, JavaScript, HeyGen avatar/TTS, HappyRobot voice calls LLM: Gemini
Challenges we ran into
Latency with LLM Gemini 1.5 pro generate decent results but too slow Coordinating multimodality outputs Prompt engineering to achieve advanced reasoning
Built With
- flask
- gemini
- happyrobot
- heygen
- javascript
- python
- vue.js
- weave
Log in or sign up for Devpost to join the conversation.