Inspiration

Many patients, especially the elderly, struggle to follow prescription plans due to illegible doctor handwriting and confusing medical shorthand. This friction causes dangerous dosing errors. We built MedsMinder AI to serve as an instant, intelligent clinical interpreter directly inside the web browser.

What it does

MedsMinder AI turns messy handwritten prescriptions into clear, digital schedules. Users simply upload an image of a prescription slip or bottle label. The system extracts medication names, clear dosage rules, and exact timing tracks. It then renders a structured checklist on screen while simultaneously triggering a live, native desktop notification alert.

How we built it

The platform utilizes a modern, performance-first web architecture:

  • Frontend: Built with Next.js 16 (App Router) and Tailwind CSS to deliver a responsive, fluidly animated dashboard layout.
  • Backend: A secure API route converts the image payload into a Base64 binary stream on the server side.
  • AI Core: The server orchestrates precise payload requests to the Google Gemini API to parse text with strict data validation parameters.

Challenges we faced

Our biggest challenge was ensuring extraction accuracy from irregular handwriting and preventing AI hallucinations. We resolved this by engineering a strict structural prompt template that forces the model to evaluate the document line-by-line. We also resolved cross-platform permission constraints to ensure browser notifications trigger reliably.

What we learned

We mastered server-side binary file streaming workflows within Next.js API routes and learned how to safely isolate third-party API credentials away from client-side view states. We also discovered how to utilize native browser push mechanisms to bypass heavy, costly notification packages.

Future Scope

  1. Twilio SMS Gateway: Integrating SMS nodes to text medication reminders directly to patients using older, offline feature phones.
  2. Web3 Privacy Ledgers: Storing patient adherence schedules securely on a decentralized network to guarantee data privacy.

Built With

Share this project:

Updates

Submission history