Pip (11 Woman In Science)

HOME SCREEEN
DEMO 2 (SHOPPING ON AMAZON) REQUESTING AN INFORMATION
PIP PROCESSING INFORMATION
GUIDEMODE
CHOOSING A SPECIFIC OPTION
DEMO 3: READING A NEWS ARTICLE; TELLS USER WHERE TO CLICK
PICKING AN ARTICLE
HIGHLIGHTING HEADER, SUMMARIZING ARTICLE

Inspiration

Drawing inspiration from our grandparents, we saw how frustrated they became when they struggled to navigate basic websites. While we love helping them, we realized we can't always be there the exact moment they get stuck. We created Pip to bridge this divide, acting as a helpful digital companion to aid them as they browse.

What it does

Pip is a voice-activated Chrome extension that acts as a friendly, browser-aware co-pilot for elderly users navigating the web. It sits on the screen, listening to voice commands and reading the context of the current webpage to provide specific guidance. Instead of giving generic advice, Pip can highlight hidden buttons, summarize confusing text, and point users in the exact right direction.

How we built it

We built the frontend as a Chrome extension that injects an accessible, high-contrast UI directly into the browser window. Under the hood, we combine speech-to-text APIs with custom DOM-parsing scripts that clean and read the webpage's structural code. This context is fed to an LLM, which processes the user's voice command and returns executable actions to the browser.

What's next for Pip

Next, we want to give Pip the ability to proactively detect and warn users about known phishing sites or deceptive pop-ups. Finally, we plan to expand our target audience to include children learning the web. We plan to create a companion dashboard so families can easily verify their loved ones are browsing safely.