Boomer Browse

A second brain. More specifically, a desktop app + browser extension duo for dementia care. It detects memory conflicts via voice and silently reshapes the web to match the user's reality.

Comment

Inspiration

My grandma, just this year, was diagnosed with dementia. She has always loved the web and loved calling us grandchildren on it from Vietnam. It was a distressing period for my family, so to bridge the widening gap between her world and ours, I wished to build Boomer Browse and giving a digital autonomy that she deserves.

What it does

Boomer Browse is a browser-based AI agent that acts as a cognitive shock absorber. It doesn’t correct; it realigns.

  • Using fetch.ai multi-agent chain, Boomer Browse recreate a second brain which changes timeline and adapt the agent's conversations as the patient's brain degenerates.
  • Help elderly with dementia to navigate the web. Not just from phrases like "Open youtube", but also from memory storage to accommodate phrases like "Open the episode of Friends I watched yesterday"
  • Underneath, Boomer Browse is also a secret health monitor which uses fetch.ai agents to infer medical symptoms from the patient's tone, words, memory gaps, confusion while browsing, etc. Medical inference is backed up by up-to-date news, connected to the agents themselves, and can be sent to health provider.
  • The browser extension also uses Open-AI to detect faces on the screen to faces stored in the app's family tree => allow patients to recognise family members on the screen during memory lapse

fetch.ai - link to agent

perception: https://agentverse.ai/agents/details/agent1qg3artwxgqsfzmfd2he8vv2epxjmd5mces650f00mdfhxcr4q6r36ge3cy6/editor drift: https://agentverse.ai/agents/details/agent1q0yt07dlgzxh4fdeyjgh06yca705ewwafhjem9tganjqsd3ruhze2qlzqdf/profile memory: https://agentverse.ai/agents/details/agent1qtm7h9gvp7fcfcllxj8x0rhe2pw0nywy0fs443sshufj2ftvq3u028x8xfe/profile

How I built it

  • Browser Use to automate browsers (the precious limbs of our app that provide digital mobility to elderly)
  • Fetch.ai to assess and remember (the brain of our app to provide digital freedom)

Accomplishments that I'm proud of

It was super super vexing but also exciting to try out all the new technology that Browser Use and Fetch.ai have created. It made me think like a developer and gave me so much more creative freedom in my product. I am also looking forward to trying out other sponsor's products in my free time and see how Boomer Browse can be further expanded!

What's next for Boomer Browse

  • Self-healing browsing loop. If the AI agent detects that a user has navigated into a 'digital dead-end' (like a confusing ad or a 404 page), it will autonomously use browser automation to redirect them back to a familiar, safe URL

https://github.com/thouartmammal/DiamondHacks

Built With

Share this project:

Updates