-
-
Home Page โ Provides an overview of AI-powered anemia detection and guides users to start the diagnosis
-
Input Page โ Allows users to upload eye, lip, and skin images along with a PPG video for anemia analysis
-
Processing Page โ Analyzes uploaded images and PPG data using AI models to detect anemia in real-time
-
Results Page โ Displays anemia diagnosis, hemoglobin estimation, and detailed analysis of the uploaded data
-
Results Page โ Displays anemia diagnosis, hemoglobin estimation, and analysis, along with an AI-powered chatbot for medical insights
๐ฉธ AI-Powered Non-Invasive Anemia Detection System
๐ Overview
The AI-Powered Non-Invasive Anemia Detection System is an innovative healthcare solution designed to analyze ๐๏ธ eye conjunctiva, ๐ lip, and ๐๏ธ skin images, along with ๐ PPG-based hemoglobin estimation, to detect anemia in a fast, non-invasive, and efficient manner. The system leverages ๐ค deep learning models and a ๐ฒ Random Forest classifier to classify anemia risk levels and recommend nearby ๐จโโ๏ธ doctors based on the user's ๐ location.
โจ Inspiration
Anemia affects over 1.6 billion people worldwide ๐, yet many cases go undiagnosed due to the lack of accessible and affordable diagnostic tools. Traditional blood tests require ๐ฅ lab infrastructure, trained personnel, and time, making them inaccessible for many rural and underserved populations.
Our inspiration came from the urgent need for an alternative, non-invasive, and AI-driven solution that could provide instant anemia detection using only a smartphone ๐ฑ. By leveraging deep learning, PPG-based hemoglobin estimation, and AI-powered decision-making, we sought to revolutionize anemia diagnosis and make healthcare more inclusive. โค๏ธ
๐ What It Does
- ๐ท Captures and analyzes images of the eye, lips, and skin to detect pallor.
- ๐น Uses PPG-based hemoglobin estimation from a smartphone camera video.
- ๐ค AI-powered chatbot provides real-time medical insights.
- ๐ Doctor recommendation system suggests nearby specialists.
- โก Runs in real-time on both web and mobile platforms for instant results.
๐๏ธ How We Built It
We structured our system into multiple AI models ๐ฅ, each focusing on a specific biomarker:
- ๐ฅ๏ธ Deep Learning Models (TF Lite) process eye, lip, and skin images to detect anemia-related pallor.
- ๐ฒ A Random Forest Classifier estimates hemoglobin levels using PPG signal extraction from a smartphone camera video. ๐ฑ
- The ๐ฌ LangChain-powered AI chatbot offers real-time medical insights and advice based on the test results.
All models were optimized for โก real-time execution, ensuring smooth performance on both web and mobile platforms. ๐
๐ง Challenges We Ran Into
1๏ธโฃ Ensuring Model Accuracy & Reliability
- Training deep learning models to distinguish subtle anemia symptoms from normal variations in skin and eye color was challenging. ๐ญ
- We used ๐ diverse datasets and augmentation techniques to improve model generalization.
2๏ธโฃ Extracting Meaningful PPG Data
- Processing ๐น finger-on-camera videos for PPG signal extraction required filtering out noise and inconsistencies.
- We implemented โ๏ธ frame-wise averaging and adaptive signal processing techniques to enhance PPG data quality.
3๏ธโฃ Optimizing for Real-Time Execution
- Running deep learning models on-the-fly required converting them into TensorFlow Lite (TF Lite)โก for efficiency.
- We minimized latency and memory usage while maintaining high accuracy. ๐
4๏ธโฃ Integrating Multiple AI Components
- Combining computer vision ๐ผ๏ธ, PPG analysis ๐, chatbot intelligence ๐ค, and doctor recommendations ๐ฅ was complex.
- We carefully structured our ๐ data pipeline to ensure seamless interaction between components.
๐ Accomplishments That We're Proud Of
โ
Successfully built an AI model capable of detecting anemia with high accuracy.
โ
Developed an intuitive, real-time system that runs efficiently on mobile and web.
โ
Integrated PPG-based hemoglobin estimation, pushing the boundaries of non-invasive diagnostics.
โ
Created an AI chatbot to offer real-time health insights.
โ
Designed a doctor recommendation system for immediate medical assistance.
๐ What We Learned
- ๐ง AI in Healthcare Requires Precision โ Model validation is critical to avoid false positives/negatives.
- ๐ PPG-based Diagnostics Are Powerful โ This technique has potential beyond anemia detection, including cardiovascular health monitoring. โค๏ธ
- ๐ฏ User Accessibility Is Key โ Making the tool simple and intuitive ensures wider adoption, especially in non-technical communities.
- ๐ค Collaboration Enhances Innovation โ The integration of ML engineers, software developers, and medical experts led to a well-rounded solution.
๐ฎ What's Next for AnemAI
๐น ๐งฌ Expand AI models to detect other blood disorders like iron deficiency & jaundice.
๐น โ Integrate wearable device support for continuous hemoglobin tracking.
๐น ๐ฒ Develop a full mobile app to make real-time anemia screening more accessible.
๐น ๐ฅ Collaborate with healthcare institutions for clinical validation & large-scale adoption.
๐ Tech Stack
| Component | Technology Used |
|---|---|
| Frontend UI | Streamlit (Python) |
| Image Processing | OpenCV, PIL |
| Machine Learning Models | TensorFlow Lite (TF Lite), MobileNetV2, CNN |
| PPG Hemoglobin Estimation | Random Forest (Scikit-Learn) |
| AI Chatbot | LangChain + Llama 3.3-70B |
| Doctor Recommendations | Google Maps API |
๐ฏ Final Thoughts
Our AI-powered anemia detection system embodies technology for social good ๐, offering a scalable, non-invasive, and accessible solution to a major global health issue. This project is not just an ideaโitโs a step toward transforming early disease detection worldwide ๐๐!
Built With
- cnn
- google-maps
- groq
- langchain
- langsmith-api
- llama
- mobilenetv2
- opencv
- pillow
- python
- scikit-learn
- streamlit
- tensorflowlite
Log in or sign up for Devpost to join the conversation.