Inspiration

Observing how much of the internet remains inaccessible to blind or visually impaired users, even with screen readers. Many websites still rely on visuals, unlabeled images, or complex layouts that make navigation frustrating. Thinking about L.O.U., a little fairy that guides adventurers (users) inside the web, who (L)ooks at the webpages, (O)utlines the contents, and (U)npacks the concepts.

What it does

L.O.U. didn’t just read contents aloud but also understood it — providing summaries, context, and alternative text for inaccessible elements like images. Understanding and focusing on the main content of the webpages. L.O.U. uses Chrome's Built-in Gemini Nano AI to summarize and explain the concepts to users, translating every webpage into the user’s preferred language. L.O.U. has been designed to flank a screen reader and not to substitute it.

How I built it

Defining a background service worker, the heart of L.O.U. is Chrome's Built-in Gemini Nano AI and Web Speech API to give a voice and guide the blind or visually impaired users. The system analyzes the language used by the webpage to tailor and enhance the prompt system to try to have better results. In addition, I created a system to collect data from the webpage to outline the contents.

Challenges I ran into

Managing asynchronous communication between the content script, background worker, especially for real-time updates. And generating useful AI responses required careful prompt engineering.

What I learned

The Chrome Extensions Manifest V3 architecture, background/service workers, and messaging between content scripts. How to integrate and handle responses from the Chrome Built-in AI Prompt API. Designing for inclusive UX, about keyboard-only activation.

What's next for L.O.U. - Eyes on the web

The next step is to expand support for voice-based commands and integration with other accessibility tools. In particular, I'd like to expand L.O.U. for every user (adding UI elements like side panels) to reduce time wasted and simplify the navigation on the webpages.

Built With

Share this project:

Updates

Submission history