CareCircle

💡 Inspiration

Caring for aging parents or family members with chronic medical conditions is one of the heaviest emotional and logistical challenges anyone can face. In real life, caregiving doesn't happen through neat spreadsheets—it happens in fragmented text messages, frantic phone calls, and forgotten doctor instructions.

When a parent has an upcoming specialist visit, multiple dependencies collide: fasting blood draws, finding recent ECG logs, refilling critical heart medications at the pharmacy, and coordinating rides between siblings. Instructions get dropped, family members duplicate work, and elderly loved ones feel isolated from the plan.

We were inspired by Amazon Alexa+ to build CareCircle: an ambient, multimodal care companion that allows family members to speak naturally—as casually as they would in conversation—and immediately transforms that unstructured dialogue into verified clinical appointments, prep checklists, accessible smart-display reminders, and synchronized family action.

🚀 What It Does

CareCircle bridges the gap between informal spoken intent and verified family coordination:

• 🎙️ Ambient Alexa+ Conversational Assistant: Caregivers can speak compound requests (e.g., "Alexa, my dad has a cardiologist appointment on Friday. Help me prepare everything, assign his meds to Sarah, and update our family circle.").
• 🧠 AI Action Interpreter with Typed Audit Trail: The assistant deterministically decomposes compound conversational speech into structured, validated actions—scheduling appointments, generating clinical checklists, and delegating tasks to specific family members with explicit success/fail verification badges.
• 📺 Amazon Echo Show 10 Ambient In-Home Display: Bridges remote caregivers with the in-home elder. A high-contrast, large-type senior display in Dad's kitchen surfaces upcoming appointments, medication reminders, and offers easy one-touch or voice confirmation ("Alexa, I took it").
• 📋 Automated Clinical Preparation Checklists: Auto-generates proactive clinical prep items (fasting blood draws, ECG records, medication lists, insurance cards) tied to each appointment with progress tracking.
• 📱 Real-Time Family Hub & 1-Click WhatsApp/SMS Dispatch: Synchronizes tasks across siblings with live status indicators, priority tags, and automated update drafts formatted for instant WhatsApp and SMS dispatch without phone tag.
• 🛡️ Strict Medical Safety Boundaries: CareCircle operates strictly as a family logistical coordination system. It enforces clinical boundaries, provides medical disclaimers, and never guesses or hallucinates unverified actions.

🛠️ How We Built It

CareCircle was built as a modern, reactive TypeScript and React application engineered for speed, multimodal clarity, and privacy:

• Frontend & Ambient UI: React 18, Vite, and Tailwind CSS, featuring bespoke ambient lighting, glassmorphism card hierarchy, and custom Alexa+ pulsing halo/waveform micro-animations (alexa-glow).
• Multimodal Smart Display Simulation: A pixel-perfect simulation of the Amazon Echo Show 10 with ambient mic arrays, high-contrast Senior Mode, and bidirectional tactile/voice confirmation flows.
• Speech & Audio Layer: Web Speech API for bidirectional voice recognition (STT) and synthesized Alexa-tone voice audio (TTS), synchronized with animated audio frequency waveforms.
• NLU & Action Engine: A deterministic, offline-capable intent parser and action execution engine supporting strict payload validation. An optional Google Gemini API integration enables enhanced conversational reasoning.
• Launch Film & Composition: Designed and scripted using the Hyperframes video-as-code engine and GSAP, timed with beat-grid audio synchronization and rendered through FFmpeg.
• State & Testing: React Context with LocalStorage persistence (carecircle_app_state_v2), full Vitest test suite, and an interactive 8-step Hackathon scenario runner built directly into the UI.

🥊 Challenges We Faced

1. Parsing Complex Compound Intent: Natural caregiving speech is messy and multi-part. Users combine appointments, errand assignments, and messaging in a single sentence. We designed an action interpreter that breaks down compound statements into discrete, ordered transactions while validating missing fields (like prompting for missing appointment times) instead of guessing.
2. Designing for Two Vastly Different Audiences: The product serves both tech-savvy adult children juggling busy schedules on mobile, and elderly care recipients looking at a kitchen smart display. We solved this by designing dual interfaces: a rich, data-dense coordination dashboard for caregivers, and a serene, high-contrast, glanceable Senior Mode for the Echo Show.
3. Ensuring 100% Truthful State: Generative AI often "pretends" an action was executed. We decoupled conversational generation from action execution: the assistant is strictly forbidden from claiming an appointment was booked or a task assigned unless the internal state engine returns an authenticated confirmation.

🏆 Accomplishments That We're Proud Of

• Zero API Key Dependency: The application is fully functional offline with an intelligent deterministic rule engine, while seamlessly scaling to LLM-powered reasoning when an API key is provided.
• Accessibility & Contrast: Reached 100% WCAG AA compliance across all dashboard elements, clinical checklist cards, and the ambient smart display.
• End-to-End Multimodal Sync: Live interaction where an action taken on the mobile caregiver board immediately syncs and reflects on Dad's simulated Echo Show screen.

📚 What We Learned

• Designing ambient smart-home experiences requires restraint—information density must drop dramatically on kitchen displays compared to desktop dashboards.
• Family caregiving is as much about psychological peace of mind as it is about logistics; knowing a sibling has accepted an errand reduces caregiver burnout significantly.
• Building deterministic safety guards around conversational AI is essential for any application touching family healthcare logistics.

🔮 What's Next for CareCircle

• Native Alexa Skill SDK Integration: Deploying native Alexa Skills Kit (ASK) packages and Alexa Presentation Language (APL) layouts to live Amazon Echo Show hardware.
• EHR / Patient Portal Calendar Ingestion: Secure HL7/FHIR integrations to auto-import clinical instructions from portals like Epic and MyChart.
• Smart Dispenser & Sensor Telemetry: Syncing ambient reminders with smart pill organizers to auto-confirm medication adherence without manual logging.

Built With

• accessibility
• ai
• alexa
• ambient-computing
• assistive-tech
• echo-show
• family-care
• ffmpeg
• gsap
• healthcare
• hyperframes
• json
• lucide-react
• multimodal
• react
• responsive-design
• smart-display
• speech-recognition
• speech-synthesis
• state-management
• tailwindcss
• typescript
• vite
• vitest
• web-speech-api