Inspiration

After spending time with the senior citizens in our community, we decided to use tech at this hackathon to improve their lifestyles. 40% of our generation will have some form of dementia in old age. The physical and mental sysmptoms of disorders on the dementia spectrum often require people with dementia to have a constant caregiver always present. We decided to aid both the caregivers and the people with dementia by providing a virtual caregiver that helps them using audio AR embedded in their glasses and visual AR through their phones.

What it does

  • alerts person to take their medicine, and reminds them of which type and what dose, while using an AR visual of the medication through their phone camera to guide them to the stored medicine location
  • detects if the person loses their balance and falls, and alerts caregivers via SMS
  • detects tremors (characteristic of dementia forms like Parkinson's) and provides audio feedback to help them reset their walking

How I built it

AR Bose Frames and Unity AR through a smartphone android app.

Challenges we ran into

1) Connectivity issues between the frames and different operating systems and devices. 2) Coordinating tasks between members while simultaneously maintaining a feasible scope 3) Learning Unity from scratch

Accomplishments that I'm proud of

  • working multi-component assistant
  • accurately detecting falls real time
  • integrating custom gestures into Bose AR SDK

What I learned

  • sleep is for the weak

What's next for safe and sound

  • sleep
Share this project:

Updates