Inspiration

The inspiration comes from watching

What it does

Uses ESP32-CAM to check for motion near medication area (motion = pills taken). Communicates with Tkinter dashboard to log the time of medication taken. Automatically resets system when it's midnight.

How we built it

Edge Hardware: Configured an ESP32-CAM as a local HTTP server for wireless image transmission.

Vision Engine: Utilized OpenCV and NumPy to implement a "rolling buffer" pixel-comparison algorithm to detect physical medication removal.

Asynchronous Dashboard: Engineered a multi-threaded Tkinter GUI to manage continuous HTTP polling without blocking the user interface.

Real-time Alerts: Using Twilio API to send a real-time confirmation SMS when meds are logged.

Challenges we ran into

Originally we were planning on using C++ to code the ESP and facilitate communication between it and the dashboard via ports. This did not work.

Accomplishments that we're proud of

Making a fully working project that has real impact and can help people's daily lives.

What we learned

There is a specific cable you need to connect the ESP32-CAM to a laptop in order for it to work.

What's next for PillPal

Implementing an app prototyped using Figma.

Built With

Share this project:

Updates