"PillSenseAI: Simplifying Meds, Protecting Health”

• 

  Create

• 

  Login

Inspiration

Many people, especially seniors or those managing multiple prescriptions, struggle to take their medications correctly and on time. Families often worry if their loved ones are safe, but with busy schedules, it’s hard to keep track. This common challenge inspired us to create a solution that combines clarity, safety, and peace of mind.

What it does

PillSenseAI lets users upload a photo of a prescription or medicine. The system instantly reviews it, explains in plain language what the medication is and when to take it, and checks for safety concerns. Users can also set personalized reminders so they never miss a dose.

How we built it

Built With: Languages: JavaScript, Node.js Frontend: React, Vite Backend: Express.js, MongoDB APIs: REST API, GeminiAPI for safety check Real-time: WebSocket (ws) for medication reminders Authentication: JWT with custom middleware Styling: CSS, keyframes Other: Modern browser APIs, localStorage/sessionStorage Approach: Users upload a prescription → AI analyzes it → plain-language explanation is generated → personalized reminders are scheduled. Focused on responsive, senior-friendly UI and secure, real-time notifications.

Challenges we ran into

Accurate Prescription Interpretation: Ensuring the AI correctly read and understood diverse prescriptions and medicine labels. User-Friendly Design for Seniors: Making the interface intuitive, clear, and accessible for older adults while maintaining functionality. Reliable Reminders: Building a system that delivers timely, personalized reminders without errors or intrusiveness. Data Privacy & Security: Protecting sensitive medical information while providing AI-driven insights and notifications. Balancing Complexity and Simplicity: Translating technical medical data into plain language without losing essential details.

Accomplishments that we're proud of

Functional MVP in record time: We turned an idea into a working prototype within hackathon constraints. End-to-end workflow: Delivered a smooth “snap → parse → explain → remind” pipeline that actually works. Complexity made simple: Translated raw medical data into plain, reliable insights people can actually use

What we learned

Designing for real users—especially seniors—requires simplicity, clarity, and empathy. Translating complex medical information into plain language is essential for trust and safety. Integrating AI with user-friendly reminders requires careful balance between accuracy, timing, and usability. Iterative design, feedback, and testing are critical to building solutions people actually rely on. Healthcare tools must prioritize privacy and security without compromising convenience.

What's next for "PillSenseAI: Simplifying Meds, Protecting Health”

We plan to expand PillSenseAI into pregnancy care, helping expectant mothers track cycles, receive reminders for prenatal vitamins, and get clear guidance on what foods, medicines, and habits are safe—or unsafe—during each stage. Beyond pregnancy, we aim to make PillSenseAI a comprehensive health companion by: Adding mobile and smartwatch integration to collect real-time health data (e.g., heart rate, activity, sleep) and personalize reminders. Enhancing user-friendly design with an even more intuitive UI/UX tailored for all age groups, especially seniors and expectant mothers. Expanding reminder features with adaptive notifications that adjust based on lifestyle and health conditions. Improving personalization by analyzing patterns in medication use and offering proactive suggestions. Exploring healthcare partnerships with pharmacies and providers to create a seamless, connected care experience.

Built With

• css
• express.js
• geminiapi
• javascript
• jwt
• mongodb
• node.js
• react
• restapi
• vite
• websockets