CareSync

💡 Inspiration

Heart disease, dementia and Parkinson's show warning signs long before a diagnosis: an irregular heartbeat, a forgotten word, a slight tremor. These signs often go unnoticed until it's too late, so we wanted an AI health advocate that's always paying attention.

CareSync catches the signs that usually slip by. Using information drawn from Canadian clinical guidelines, it serves as your early warning system. When something is off, CareSync finds the nearest clinic and books an appointment that fits your schedule, all in one click. It handles the booking automatically by web form, email or AI phone call.

⚙️ What it does

• Symptom tracking: picks up symptoms from conversation, uploaded doctor's notes and lab results, and optional smartwatch data
• At-home assessments: short tests like word recall and finger tapping for heart and stroke, cognitive decline, and Parkinson's
• Transparent risk scoring: every flag is rated using Canadian clinical guidelines and explained with cited sources
• Automatic booking: finds a nearby clinic, matches your calendar and books it once you approve

🛠️ How we built it

Frontend

• Web app with a dashboard, vitals charts, medications, appointments and AI chat

Backend

• PostgreSQL (Neon) with pgvector for data and guideline search
• Google sign-in, encrypted tokens and consent tracking

AI Chat Agent

• Gemini API for the health chat and for extracting symptoms and lab values from messages and photos
• RAG (Retrieval-Augmented Generation): retrieves the most relevant passages from 34 Canadian clinical guidelines, and Gemini answers only from them with citations, saying "I don't know" instead of guessing

AI Booking Agent

• Phone calls: Twilio places the call, ElevenLabs provides a natural, human-like voice, and Gemini decides what to say in real time
• Web forms: Playwright finds and fills in clinic booking forms automatically
• Scheduling: Google Calendar matches appointment times to your schedule

🏆 Accomplishments that we're proud of

• An AI agent that finds nearby clinics and doctors and books appointments automatically in three ways:
  1. AI phone calls that speak naturally with the receptionist
  2. Web form booking, even on custom-built clinic sites
  3. Email requests sent to clinic addresses it finds online
• A fully working website, front end and back end, with secure login, encrypted data and a unified dashboard

🧠 What we learned

• Integrating the Gemini API, from extracting symptoms out of text and photos to building a RAG pipeline that answers only from clinical guidelines
• Using Playwright to scrape clinic websites and fill in forms, even when every site is built differently
• Connecting Twilio, ElevenLabs and Gemini into a voice agent that holds real phone conversations

🚀 What's next for SyncCare

• 🩺 Clinical review of our risk rules and testing with real users
• 📞 A smarter booking agent that handles clinic callbacks and rescheduling
• ⌚ More wearable integrations

Built With

• css
• eleven-labs
• fastapi
• google-calendar-api
• google-gemini
• google-outh
• google-places
• javascript
• neon
• pgvector
• playwright
• postgresql
• python
• react
• resend
• sqlalchemy
• twilio
• vite