Inspiration

We wanted to leverage the power of AI to help elders and their caretakers to take their medications more carefully, as we think that a more rigourous schedule is most likely to lead to a more effective treatment.

What it does

Our app is mainly designed around our pill-taking feature. Not only it will notify the user when they have to take their pills, but it will also alarm their caretaker when they do not. Using computer vision and OCR, we designed a module to minimize friction between our users and the app, by allowing them to scan their prescription to create their schedule. Finally, our flagship feature lets the user record themselves taking their pill and, by AI, we can confirm it has been taken properly.

How we built it

-Using PWAs to bring this idea to mobile, without having to write native code. -Because we know data privacy is a sensitive subject, every image recognition features are done on-device. -Firebase for secure authentication -MongoDB Atlas for data persistancy, Triggers are used to periodically fetch for upcomming medications that have to be taken -Twillio to send notifications -GoDaddy for the domain name -Groq

Challenges we ran into

-Running computer vision models on a browser with JS -?

Accomplishments that we're proud of

-Made everything on-device

What we learned

-Teamwork -Integrating AI models into web apps

What's next for Smartpill

-Expand to different types of medecine (band aids, creams, etc.)

Built With

Share this project:

Updates