Accessibility AI Assistant

Inspiration

The inspiration for the Accessibility AI Assistant came from the need to make the internet more accessible to everyone, regardless of their abilities or language proficiency. We noticed that many existing tools either lacked comprehensive features or required constant internet connectivity, which could be a barrier for some users. Our goal was to create a tool that is not only powerful and versatile but also works offline to ensure privacy and reduce latency.

What it does

The Accessibility AI Assistant is a Chrome extension designed to enhance internet accessibility. It includes a screen reader that reads aloud the text on a webpage, an auto-translate feature that translates content into the user's preferred language, and an AI Assistant that summarizes webpage content and answers user questions. These features make it easier for users with visual impairments, language barriers, or reading difficulties to access and understand web content.

How we built it

We built the Accessibility AI Assistant using TypeScript and SvelteKit, leveraging Chrome's built-in AI APIs for translation, language detection, summarization, and prompt generation. The development process involved extensive testing to ensure that the extension works seamlessly across different websites and provides accurate translations and summaries. We also focused on optimizing the performance to ensure that the extension runs smoothly without causing significant delays.

Challenges we ran into

One of the main challenges we faced was ensuring the accuracy and reliability of the summaries provided by the AI APIs. We had to fine-tune the parameters and conduct thorough testing to ensure that the results were consistent and useful. Another challenge was optimizing the performance of the extension to minimize latency and ensure a smooth user experience, especially when processing large amounts of text.

Accomplishments that we're proud of

We are proud of creating a tool that significantly enhances internet accessibility for a diverse audience. Our extension not only provides accurate translations and summaries but also works offline, ensuring user privacy and reducing latency. We are also proud of the positive feedback we have received from users who have found the extension to be a valuable tool for accessing and understanding web content.

What we learned

Throughout the development process, we learned a lot about the challenges and opportunities in creating accessible technology. We gained a deeper understanding of the needs of users with visual impairments and language barriers, and how to design solutions that address these needs effectively. We also learned about the importance of optimizing performance and ensuring the accuracy of AI-generated content.

What's next for Accessibility AI Assistant

In the future, we plan to add more features to the Accessibility AI Assistant, such as support for additional languages and more advanced AI capabilities for content summarization and question answering. We also aim to continuously improve the accuracy and performance of the extension based on user feedback. Additionally, we are exploring ways to integrate the extension with other accessibility tools to provide a more comprehensive solution for users with diverse needs.

Built With

• svelte
• sveltekit
• typescript