Inspiration

In today's world, the widespread use of medication has become a common occurrence, often leaving individuals with questions and uncertainties about the drugs they consume. Whether it's deciphering the right medication or understanding potential side effects, the need for accessible and comprehensive information is evident. In response to this pressing need, we introduce MedsXplore, a sophisticated and user-friendly web interface embedded with AI technolgies meticulously designed to empower individuals with the knowledge essentialfor making informed decisions concerning their medications.

What it does

MedsXplore serves as a transformative solution by simplifying the process of acquiring vital information about medications. Users are granted the ability to seamlessly scan and upload images of their medications, which can encompass various forms such as pills, pill strips, or syrup bottles. Upon uploading the image, the MedsXplore system swiftly processes the data and delivers a wealth of pertinent information that includes the medication's intended purpose, potential side effects, and intricate details about the manufacturer. Additionally, user-generated reviews are readily accessible, offering valuable insights from individuals who have previously used the same medication. MedsXplore takes user convenience to the next level by providing a "Buy now" feature, strategically positioned for quick access to trusted sources for medication procurement. These trusted sources encompass established medicine buying apps or websites, offering a seamless and familiar path to medication acquisition. Recognizing the diversity of its user base, MedsXplore ensures accessibility by offering information in multiple languages, including Hindi and English. This multilingual approach caters to the needs of individuals from various linguistic backgrounds, making critical medication information widely accessible. MedsXplore takes its commitment to inclusivity even further with the integration of an audio feature. This innovative addition allows the platform to narrate medication details audibly, thereby enhancing usability for individuals with varying preferences or accessibility requirements. Whether a user is visually impaired or simply prefers auditory information consumption, MedsXplore accommodates these preferences effectively. In addition, if the user is unable to find the details of a particular medicine, they can register a complaint, and the admin will be notified about the unavailability of certain medicine details in our system. The admin can then update the information

How we built it

We built the system through a meticulous process, starting with the design of an intuitive and user-friendly interface optimized for both mobile and web platforms. The implementation of OCR functionality was achieved using the Microsoft Azure Computer Vision API, allowing accurate extraction of text from images. To enhance OCR accuracy, we incorporated image pre-processing techniques, adjusting brightness, contrast, and image quality as needed. The backbone of the system is a comprehensive dataset containing details of approximately 11,000 medicines, organized in a structured format for efficient data retrieval. The text matching and redirection functionalities were developed to compare OCR-recognized text with the dataset, ensuring precise matches lead users to dedicated pages displaying relevant medicine details. We integrated both exact and partial text matching to account for OCR inaccuracies, enhancing the system's adaptability. The machine translation feature was implemented to provide users with the flexibility to view medicine details in their preferred language, utilizing accurate and contextually relevant translations from the dataset. Furthermore, for accessibility, we incorporated JavaScript libraries to enable text-to-speech functionality, allowing users to listen to narrated medicine details with clarity and understanding, catering to individuals with visual impairments or those who prefer audio information. The entire system was meticulously crafted to deliver a comprehensive and user-centric platform for accessing medicinal information seamlessly.

Challenges we ran into

The main challenge faced is to extract accurate text from the medicine image. Depending on the extracted text, our system further operates to provide accurate details about the medicine. Structuring the dataset of medicines correctly is also a significant challenge that we have addressed in order to ensure the efficacy of the system.

Accomplishments that we're proud of

  1. Users can effortlessly scan and upload a picture of the medicine, eliminating the need for tedious data entry and complex searches.
  2. Our system supports multiple languages, providing vital information in the user's preferred language, fostering a more inclusive experience.
  3. With a commitment to accessibility, audio narration of medicine information is available. This feature ensures that even those with visual impairments can access vital details with ease.
  4. Users can access trusted websites and sources directly through hyperlinks embedded within the system. This guarantees reliable and up-to-date information.
  5. Our enhancing enhances the user trust by facilitating visual confirmation helping make informed decisions

What we learned

Throughout the development process, we gained valuable insights and lessons that contributed to the refinement and improvement of our system. Firstly, we learned the intricacies of designing a user-friendly interface, emphasizing the importance of intuitive navigation for both web and mobile platforms. The implementation of OCR using the Microsoft Azure Computer Vision API taught us the significance of image pre-processing techniques to enhance text extraction accuracy. Compiling and structuring a comprehensive dataset of medicine details provided insights into effective data organization for efficient retrieval. The challenges faced in text matching and redirection underscored the importance of precision in recognizing and processing extracted text for seamless user experiences. The incorporation of both exact and partial text matching highlighted the need for adaptability to accommodate potential inaccuracies in OCR results. Integrating machine translation services taught us about providing language flexibility for users. Lastly, the implementation of text-to-speech functionality enhanced our understanding of accessibility features, catering to users with visual impairments or those who prefer audio information. Overall, this project provided us with a wealth of knowledge in designing, developing, and optimizing a system that prioritizes user experience and accuracy in medicinal information retrieval.

What's next for MedsXplore

1.To introduce user accounts to allow individuals to save their medicine preferences, track their search history, and receive personalized recommendations based on their usage patterns. 2.Explore integration with electronic health record systems to provide users with a more holistic view of their medications, including prescription details, dosage information, and potential interactions.

Built With

Share this project:

Updates