Clarity Cap

Clarity Cap will help those with Alzheimers and short term memory loss recall the context of social situations by recognizing faces and providing brief summaries of their relationships.

Comment

Inspiration

Our team was inspired to build a hack that would allow those with Alzheimers and short term memory degradation to quickly remember people they have recently interacted with as well as the relationships they shared with them. "Clarity Cap" was built to be a portable memory aid that can be worn on the go and helps jog the memory of the wearer to provide context when it is needed.

What it does

Our device consists of (2) components. The first component is the hat with a webcam assembled on top which acts as the eyes and allows our device to see people around the wearer. The second component is the touchscreen wristband which provides text based output to display names and relationships as users interact with people in their environment.

How we built it

We used a Raspberry Pi 5 which was connected to an RP3508 Screen, and a Webcam. The Raspberry Pi and Webcam were mounted on a baseball hat with the display being glued onto a wristwatch to help in providing output. In terms of the tech stack, we used Flask to host a local web server and are using this along with facial recognition that breaks down each face into unique identifiers which helps it recognize old and new faces.

Challenges we ran into

During the project, the display screen that we were planning to use was not starting up. We overcome this challenge, by discussing the viability of a couple other screens that we had on hand. Additionally, we realized that our Raspberry Pi 5 was running very hot midway through the hackathon. We worked around this by implementing a heatsink and 3D Printed the appropriate housing structure that could fit the pi 5 as well as the heatsink.

Accomplishments that we're proud of

We were able to build a working prototype around halfway through the Hackathon! It was also the first time members of our team explored AI models such as Llama3.

What we learned

We learned that perseverance is key. Thinking about those who face difficulties daily with imapairments, we trucked on past all challenges until "MyMemory" was functional!

What's next for Clarity Cap

We would like to expand on the functionality of "Clarity Cap" by adding the ability to understand the context of relationships using speech recognition and large language AI models. additionally, we could add features in which the text that is currently being displayed on the wrist can instead be outputted via audio.

Built With

Share this project:

Updates