Inspiration
The idea stemmed from the noticeable lack of accessible web navigation tools tailored for visually impaired users. Many struggle with traditional browsing methods, relying heavily on screen readers that can be cumbersome. Personal stories from visually impaired individuals underscored the need for a voice-driven solution to make the internet more inclusive and intuitive.
What it does
This Chrome extension adds a floating AI assistant to any webpage, empowering visually impaired users to navigate and interact with content using natural voice commands. The assistant can describe page elements, click links, scroll, and respond to questions—all through seamless voice input and output, enhancing web accessibility.
How we built it
We leveraged the following technologies: Chrome extension framework for seamless browser integration. Web Speech API for real-time voice recognition and text-to-speech functionality. DOM parsing to analyze and interact with webpage elements. An external LLM API (e.g., GPT-4) to provide contextual understanding and generate concise content summaries.
Built With
- chrome
- javascript
- openai
- python
Log in or sign up for Devpost to join the conversation.