๐Ÿฉธ AI-Powered Non-Invasive Anemia Detection System

๐ŸŒŸ Overview

The AI-Powered Non-Invasive Anemia Detection System is an innovative healthcare solution designed to analyze ๐Ÿ‘๏ธ eye conjunctiva, ๐Ÿ‘„ lip, and ๐Ÿ–๏ธ skin images, along with ๐Ÿ“Š PPG-based hemoglobin estimation, to detect anemia in a fast, non-invasive, and efficient manner. The system leverages ๐Ÿค– deep learning models and a ๐ŸŒฒ Random Forest classifier to classify anemia risk levels and recommend nearby ๐Ÿ‘จโ€โš•๏ธ doctors based on the user's ๐Ÿ“ location.


โœจ Inspiration

Anemia affects over 1.6 billion people worldwide ๐ŸŒ, yet many cases go undiagnosed due to the lack of accessible and affordable diagnostic tools. Traditional blood tests require ๐Ÿฅ lab infrastructure, trained personnel, and time, making them inaccessible for many rural and underserved populations.

Our inspiration came from the urgent need for an alternative, non-invasive, and AI-driven solution that could provide instant anemia detection using only a smartphone ๐Ÿ“ฑ. By leveraging deep learning, PPG-based hemoglobin estimation, and AI-powered decision-making, we sought to revolutionize anemia diagnosis and make healthcare more inclusive. โค๏ธ


๐Ÿ”Ž What It Does

  • ๐Ÿ“ท Captures and analyzes images of the eye, lips, and skin to detect pallor.
  • ๐Ÿ“น Uses PPG-based hemoglobin estimation from a smartphone camera video.
  • ๐Ÿค– AI-powered chatbot provides real-time medical insights.
  • ๐Ÿ“ Doctor recommendation system suggests nearby specialists.
  • โšก Runs in real-time on both web and mobile platforms for instant results.

๐Ÿ—๏ธ How We Built It

We structured our system into multiple AI models ๐Ÿฅ, each focusing on a specific biomarker:

  • ๐Ÿ–ฅ๏ธ Deep Learning Models (TF Lite) process eye, lip, and skin images to detect anemia-related pallor.
  • ๐ŸŒฒ A Random Forest Classifier estimates hemoglobin levels using PPG signal extraction from a smartphone camera video. ๐Ÿ“ฑ
  • The ๐Ÿ’ฌ LangChain-powered AI chatbot offers real-time medical insights and advice based on the test results.

All models were optimized for โšก real-time execution, ensuring smooth performance on both web and mobile platforms. ๐ŸŒ


๐Ÿšง Challenges We Ran Into

1๏ธโƒฃ Ensuring Model Accuracy & Reliability

  • Training deep learning models to distinguish subtle anemia symptoms from normal variations in skin and eye color was challenging. ๐ŸŽญ
  • We used ๐Ÿ“ˆ diverse datasets and augmentation techniques to improve model generalization.

2๏ธโƒฃ Extracting Meaningful PPG Data

  • Processing ๐Ÿ“น finger-on-camera videos for PPG signal extraction required filtering out noise and inconsistencies.
  • We implemented โš™๏ธ frame-wise averaging and adaptive signal processing techniques to enhance PPG data quality.

3๏ธโƒฃ Optimizing for Real-Time Execution

  • Running deep learning models on-the-fly required converting them into TensorFlow Lite (TF Lite)โšก for efficiency.
  • We minimized latency and memory usage while maintaining high accuracy. ๐Ÿ“Š

4๏ธโƒฃ Integrating Multiple AI Components

  • Combining computer vision ๐Ÿ–ผ๏ธ, PPG analysis ๐Ÿ“Š, chatbot intelligence ๐Ÿค–, and doctor recommendations ๐Ÿฅ was complex.
  • We carefully structured our ๐Ÿ”„ data pipeline to ensure seamless interaction between components.

๐Ÿ† Accomplishments That We're Proud Of

โœ… Successfully built an AI model capable of detecting anemia with high accuracy.
โœ… Developed an intuitive, real-time system that runs efficiently on mobile and web.
โœ… Integrated PPG-based hemoglobin estimation, pushing the boundaries of non-invasive diagnostics.
โœ… Created an AI chatbot to offer real-time health insights.
โœ… Designed a doctor recommendation system for immediate medical assistance.


๐Ÿ“š What We Learned

  • ๐Ÿง  AI in Healthcare Requires Precision โ€“ Model validation is critical to avoid false positives/negatives.
  • ๐Ÿ“Š PPG-based Diagnostics Are Powerful โ€“ This technique has potential beyond anemia detection, including cardiovascular health monitoring. โค๏ธ
  • ๐ŸŽฏ User Accessibility Is Key โ€“ Making the tool simple and intuitive ensures wider adoption, especially in non-technical communities.
  • ๐Ÿค Collaboration Enhances Innovation โ€“ The integration of ML engineers, software developers, and medical experts led to a well-rounded solution.

๐Ÿ”ฎ What's Next for AnemAI

๐Ÿ”น ๐Ÿงฌ Expand AI models to detect other blood disorders like iron deficiency & jaundice.
๐Ÿ”น โŒš Integrate wearable device support for continuous hemoglobin tracking.
๐Ÿ”น ๐Ÿ“ฒ Develop a full mobile app to make real-time anemia screening more accessible.
๐Ÿ”น ๐Ÿฅ Collaborate with healthcare institutions for clinical validation & large-scale adoption.


๐Ÿ›  Tech Stack

Component Technology Used
Frontend UI Streamlit (Python)
Image Processing OpenCV, PIL
Machine Learning Models TensorFlow Lite (TF Lite), MobileNetV2, CNN
PPG Hemoglobin Estimation Random Forest (Scikit-Learn)
AI Chatbot LangChain + Llama 3.3-70B
Doctor Recommendations Google Maps API

๐ŸŽฏ Final Thoughts

Our AI-powered anemia detection system embodies technology for social good ๐Ÿ’™, offering a scalable, non-invasive, and accessible solution to a major global health issue. This project is not just an ideaโ€”itโ€™s a step toward transforming early disease detection worldwide ๐ŸŒ๐Ÿš€!

Built With

Share this project:

Updates