Inspiration
Post-discharge patients often feel isolated, confused, and unsupported during their recovery. We realized that while hospitals focus on treatment, there is a gap in personalized, continuous support once a patient returns home. Inspired by stories of recovery struggles, especially among patients with chronic conditions and limited health literacy, we set out to build Ayush-Healo — an AI-powered neuro-wellness assistant that bridges this gap with care, intelligence, and human-like interaction.
What it does
Ayush-Healo is a gamified post-discharge recovery and donation-support platform that empowers patients and donors with:
🧠 AI-powered daily check-ins: Personalized to both medical and emotional state
🎯 Gamified health milestones: Recover, learn, and get rewarded
🔐 Secure health data locker: Shareable with doctors, encrypted on-device
📸 Selfie/video-based tasks: Patients do smile-checks, face relaxation games, learn about anatomy using AR
🗣 Multilingual health AI: Asks, listens, reminds, and supports — even offline
🧬 All-disease support: Built for cancer, genetic disorders, trauma, neuro and more
🧭 Donor–Recipient AI match: Notifies hospitals & families instantly when a match is nearby
⏱ Real-time donor eligibility tracker: Detects if a donor is emotionally, legally and biologically ready
📡 Emergency fallback & AI override: If the patient is unresponsive or vitals crash, the AI takes over — alerting contacts, doctors, and initiating self-navigation (SARTHI-mode crossover)
🎥 Screenshot and screen record alerts: Privacy-respecting and foolproof
🧘 Emotional-AI insights: Detects mood swings, provides relaxation audio/video, and nudges therapy when needed
How we built it
We used a combination of:
- Flutter for the cross-platform mobile app
- Firebase for user authentication and real-time data
- TensorFlow & DeepFace for facial emotion, age, and drowsiness detection
- LLMs (Local + Online) to power the AI chatbot for health Q&A and guidance
- Secure backend logic for privacy protection and medical alert routing
- VR & AR modules for an interactive anatomy and condition-learning game
Challenges we ran into
- Integrating offline LLM models with limited mobile resources
- Creating a real-time emotion recognition system that respects user privacy
- Handling medical data securely while complying with privacy best practices
- Designing a gamified flow that feels helpful, not overwhelming
- Aligning multilingual voice AI with context-specific health queries
Accomplishments that we're proud of
- A complete offline + online AI assistant tailored for post-hospital recovery
- Real-time facial + health monitoring features, tested successfully
- Innovative gamification of health routines through fun check-ins and tasks
- Privacy features rarely seen in health apps — screenshot alerts, camera control
- Built a secure communication system between patient, caregiver, and doctor
What we learned
- Personalization and empathy matter in healthcare apps more than flashy tech
- AI can greatly assist but must remain transparent and respectful
- Designing for vulnerable users requires balancing security, clarity, and comfort
- It’s possible to combine technical ambition with real-world impact in a short hackathon timeframe
What's next for Ayush-Healo
- Integration into AyushVANI(our ongoing project): Ayush-Healo will serve as the recovery and donor-care arm of the larger AyushVANI neuro-wellness ecosystem, allowing seamless AI continuity from hospital discharge to daily wellness.
- Universal Disease Coverage: Unlike condition-specific apps, Ayush-Healo is built to adapt across nearly all health problems — from chronic illnesses like diabetes and cancer to rare genetic disorders and surgical recovery. Its AI evolves with user health needs.
- AI-powered Donor–Recipient Bridge: A unique upcoming feature will intelligently **match donors and recipients in real time based on medical urgency, location, transport feasibility, and consent — creating an emergency-ready donor pipeline.
- Donor Readiness AI: The system will **assess donor eligibility in real time (based on health data, emotional state, recent medications, etc.) and alert when a donor is physically and legally ready — something most systems ignore.
- Emotion + Vital Sync Alerts: Combines facial emotion, voice tone, and vitals (via wearable or camera cues) to **predict emotional or physical crashes before they happen — useful for at-risk patients.
- Neuro-Adaptive Interface: The app's interface will adjust based on the user’s mental fatigue, cognitive load, and expression. For example, it becomes simpler and calmer when the user appears distressed.
- Local & Global Health Data Learning: With user consent, Ayush-Healo will help train models to recognize rare disease patterns, improving rural healthcare and emergency predictions globally.
- Cross-border SOS Integration: In future versions, Ayush-Healo will be able to trigger **international medical rescue chains, especially for Indian diaspora or medical tourists.
Our goal is to not just win a hackathon — but to create a landmark in medical-AI convergence, improving lives at scale.
Built With
- ai
- amazon-web-services
- anti-screenshot-protection
- apple-health
- blockchain-ledger-(future)
- css3
- custom-js-games
- dart
- deepface
- dlib
- doctor
- e2ee
- express.js
- face-unlock
- fastapi
- firebase-auth
- firestore
- fitbit-api
- flask
- flutter
- flutter-flame
- gene-ai-forecasting-(future)
- google-cloud
- google-fit
- google-translate-api
- gpt-4
- gtts
- html5
- insightface
- javascript
- keras
- lottie
- mediapipe
- mongodb
- multilingual-ui
- node.js
- opencv
- pin-auth
- pwa
- python
- raspberry-pi
- rtl-support
- secure-camera-access
- simulation
- speechsynthesis-api
- svg-animations
- tailwind-css
- tensorflow
- twilio
- unity
- vr-anatomy-learning
- web-speech-api
- webrtc
- whisper
Log in or sign up for Devpost to join the conversation.