Inspiration
We were inspired by the the desire to help people with dementia. One of our team member's grandma suffered from Dementia from many years while his family took care of her. She would often wake up with little recollection of people she interacted with the day before and it was a caused her quite a lot of distress and confusion.
What it does
This is an interface for people suffering from dementia that assists them in recalling people that they already know and remembering people they just met. If the user has already met a person and needs help remembering them, the UI will show them a picture of the person, along with details such as their name and where they met. If the user meets someone for the first time, they have an option of "remembering" the person by saying "(person's name)". This snaps a picture of the person in front of them and adds it to the database of people the already know with the relevant information. The interface also incorporates the location of the user and the last people they interacted with, so that in case they are missing, loved ones can find them.
How we built it
The physical configuration includes a hat, a Web camera and a raspberry Pi. The camera is mounted on the hat for the ease of use of the user, and the raspberry Pi incorporates the software and processing power.
Challenges we ran into
Learning new APIs, networks problems, making hardware work with the written software, making a User Interface, using facial and voice recognition.
Accomplishments that we're proud of
We are proud of overcoming all of the challenges listed above and making a working interface in 24 hours.
What we learned
We learned how to use a raspberry Pi, how to integrate software and write software for image and voice recognition. We learned how to make a User Interface and how to use geo location with Google API.
What's next for reMindme
A smaller camera would increase the ease of use for the users, as it would be less noticeable on a hat. Wireless communication with the raspberry Pi would also increase the mobility of a user. Faster processing power would allow the video to lag less and thus take clearer pictures of people. The voice recognition software also needs improvement in understanding different accents. There is currently only a web interface, and the next step would involve expanding to make an android and IOS application.
Built With
- facial-recognition
- opencv
- python
- raspberry-pi
- ui
- voice-recognition
- webcam
Log in or sign up for Devpost to join the conversation.