MedInfoBot

Say goodbye to prescription confusion. MedInfoBot is your trusted AI prescription companion, making healthcare accessible and medication understanding simple.

Comment

Are you tired of the confusion and uncertainty that often accompanies medication prescriptions? Introducing MedInfoBot, your trusted companion on your healthcare journey. We understand that understanding medication details can be challenging, and that's why we've designed MedInfoBot to simplify medication understanding and make healthcare more accessible than ever before.

What it does

With MedInfoBot, you can effortlessly extract important information from your prescriptions, including medication names, dosages, and what it does. Say goodbye to the complexity of medical terms. Our user-friendly interface provides clear and concise explanations of common uses of your medicine and potential side effects, along with audio descriptions, for those visually impaired, empowering anyone to make informed decisions about your own health.

Key Features:

Prescription Information Processing MedInfoBot employs Optical Character Recognition (OCR) to extract prescription details from images, ensuring accurate and reliable data retrieval.

User-Friendly Interface The application boasts an intuitive and user-friendly interface, making it accessible to users of all backgrounds and ages.

AI-Powered Explanations MedInfoBot utilizes the OpenAI API to generate clear and concise explanations of medication details, enhancing your understanding of what you're taking.

Hardware Integration Powered by the Milk-V Duo board and the CAM-GC2083 camera module, MedInfoBot leverages efficient hardware capabilities for accurate image capture and processing.

Expandable Features The Milk-V Duo board's versatility allows for the seamless integration of future additional features, such as human emotion detection and prediction with the camera module.

Technologies

Hardware Components

MedInfoBot operates on a low cost, low power consumption, high performance $5 RISC-V computer, ensuring that our solution is not only accessible but also incredibly efficient.

Milk-V Duo Board This ultra-compact embedded development platform is powered by the CV1800B chip, capable of running Linux and RTOS. It provides a reliable, low-cost, and high-performance foundation for MedInfoBot. The board features dual processors, versatile GPIO pins, USB support, and more, making it a perfect match for this healthcare application.

CAM-GC2083 Camera Module The GLAXYCORE's GC2083 CMOS Image Sensor, is a camera module thatoffers up to 2MP resolution, ensuring high-quality imaging. It seamlessly integrates with the 16P MIPI CSI interface on the Milk-V Duo board, enabling advanced imaging capabilities. With features like optical excellence, high sensitivity, and impressive dynamic range, this camera module enhances the MedInfoBot's image capture capabilities significantly.

Software Components This bot makes liberal use of various machine learning/AI models to perform its desired functions.

PyTesseract PyTesseract is a Python wrapper for Google's Tesseract Optical Character Recognition application. This allows the bot to take an image as an input, and output the recognizable text that appears in the image.

OpenAI/ChatGPT OpenAI's ChatGPT LLM was used to process the text output from PyTesseract and extract the medication name from the text. It was also then used to return useful information about the specified medication.

GTTS GTTS (Google Text To Speech) is a python wrapper for Google's Text to Speech functions. It was used to generate an audio file of the medication name and description outputted by the previous software component.

Together, these hardware components and software technologies power MedInfoBot to simplify medication understanding and promote healthcare accessibility.

What's next for MedInfoBot

As we move forward, MedInfoBot aims to expand its capabilities and impact in the healthcare space. Here's a glimpse of what's on the horizon:

Multi-Language Support
Accessibility to healthcare information for a global audience with support for multiple languages.

Integration with Hume AI
Exploring emotion detection capabilities to provide personalized support alongside medication information.

Voice Assistance
Making MedInfoBot even more accessible with voice command features for medication inquiries.

User Profiles
Personalized profiles to track medication history, receive reminders, and get tailored recommendations.

Medical Database Integration
Currently, ChatGPT is used to search for information about the given medication. In the future, this can be upgraded to searching in a pre-compiled/pre-assembled medical database in order to speed up bot functions and improve medication accuracy.

MedInfoBot's journey doesn't end here! We are your gateway to simplified medication understanding and informed healthcare decisions. Join us in making healthcare more accessible and understandable for everyone.

Built With

  • gtts
  • openai
  • pil
  • pytesseract
  • python
Share this project:

Updates