Project Story

My parents are getting older, and with the aging process, they are developing a lot of health issues. My dad, for instance, is struggling with high glucose levels and diabetes, and he forgets to take his medication and also doesn't know how to distinguish which medication to take and at what time. We noticed how challenging it can be to keep track of multiple medications and schedules. Inspired by the desire to make medication management simple, safe, and stress-free for my parents and everyone, we created MedSnap.

What it does

MediSnap is a mobile app that helps seniors and their caregivers manage medication schedules effortlessly. Users take a photo of their medication or prescription, and MediSnap uses AI to recognize the medicine, automatically generating a reminder schedule. The app features large, easy-to-read buttons and a friendly, approachable design, making it perfect for older adults. It also includes caregivers in the loop in case of missing medication; they receive a notification warning about the missed/delayed medication taken.

How we built it

We built MedSnap using Expo and React Native for cross-platform mobile development. For AI-powered image and text analysis, we integrated Google Gemini Pro, allowing the app to understand medication details from photos and prescriptions. The frontend is designed with accessibility in mind, featuring bold, simple layouts and a kawaii-style mascot to guide users. For db used supabase to store data with ease.

Challenges we ran into

One of the biggest challenges was ensuring accurate recognition of various medication types and prescriptions, especially from poor lighting or blurry photos. We also focused on making the app intuitive and easy to use for seniors, which required careful UI/UX design.

Accomplishments that we're proud of

I'm actually proud to have created an app that truly addresses a real-world problem, something close to heart and would actually help my parents and parent of friends too and maybe even strangers. Being able to have db, auth, AI done easy, and removing all of the the crazy overload of manual input etc, just snap, add to schedule and voila.

What we learned

Through this project, we learned the importance of user-centered design, especially for older adults. We also gained valuable experience in integrating advanced AI models into mobile apps and handling real-world data inputs like photos of prescriptions and medication. Another thing I've learned is that our parents don't understand what "AI-powered means, so I really had to simplify the copy to the best of my abilities while testing with my parents (63 and 65 years old). Another thing is the importance of having a copy that made it clear that the data is prone to error, and it's good to double-check.

What's next for MedSnap

Next, test with more seniors and care givers, plan to add features such as family notifications for missed doses(it's added via email notification, but I want to make it even better), multilingual support, and partnerships with healthcare providers. We’re also exploring ways to make MedSnap available to more users worldwide and continuously improve its AI accuracy, maybe fine-tune models for better results. also figure out a way to monetize in a healthy balance.

Built With

Share this project:

Updates