Inspiration

This project originated from my hobby: Adult Colouring Books! After further research, I learned that colouring books are also used by elderly people to stimulate their brains!

The Problem: The "Clinical Gap" in Home Care Dementia affects millions, yet home-based care often lacks objective tools to track cognitive decline between doctor visits. Current screening tests (like the Clock Drawing Test) can be stressful and clinical for patients. Meanwhile, caregivers are left without data-driven insights into their loved ones' daily mental and motor health.

By leveraging Reminiscence Therapy, we turn a routine leisure activity into a powerful cognitive exercise. While the patient colors, MindFill’s backend is silently at work, acting as a digital "biometric sensor."

What it does

Reimagined health monitoring by hiding it inside a calming, "adult coloring" web experience. MindFill uses Computer Vision to turn any personal photo—a wedding day, a favorite pet, cartoon characters, a childhood home—into a personalized coloring template.

How we built it

Frontend: React, HTML5 Canvas, Tailwind CSS, Typescript. AI/Analysis: Gemini API for behavioural analysis and reminiscence prompting. Computer Vision: image-js for adaptive edge detection and line-art generation. Database: Supabase for secure session storage.

Challenges we ran into

I had a tough time transforming an uploaded image and turning it into a template for colouring. The Canny edge detector helped me build that feature. Next was researching which symptoms I could target in the analysis. It was difficult to find symptoms that I thought could be fairly assessed using math and LLMs.

Accomplishments that we're proud of

I love how accessible the website turned out! It feels like a website my grandparents could use without much hassle. Which is very important for the demographic I'm targeting.

What we learned

My first time solo hacking had a lot of time management involved, from ideation, functional + non functional requirements, researching open source libraries + algorithms, to prototyping the website, it's been a whole 24 hours of challenges!

What's next for MindFill

Improving the user experience! A key next step would include user authentication and setting up your profile, including if you're a patient, caretaker or using this app for leisure.

Built With

Share this project:

Updates