AURA | Devpost

AURA Software

Inspiration

Access to education and employment opportunities remains a significant challenge for blind individuals. While assistive technologies exist, many lack integration with AI-driven solutions that can enhance real-time accessibility. Our goal with AURA is to bridge this gap, empowering blind learners and professionals by reducing daily hindrances and improving their independence in academic and workplace environments.

What it does

AURA is an AI-powered accessibility tool designed to: Enhance Learning: Converts text into interactive AI-driven audio summaries, provides real-time explanations for code and math, and describes images using AI-generated speech. Improve Workplace Accessibility: Offers AI-powered document reading, navigation assistance, and task automation using voice commands. Seamless Integration: Works with existing workplace tools to help employers better accommodate blind employees with minimal effort.

How we built it

We used OpenAPI and GoogleT5 models to read, summarize and answer followup question. Integrated it with Flask UI. Used GPT model for picture explanation and other complex behaviour. Used python for all the scripting.

Challenges we ran into

Finding write model for each feature

Accomplishments that we're proud of

Able to work through all the phases from ideation to delivery

What we learned

The importance of inclusive design in AI solutions. How to optimize AI for accessibility, ensuring natural and effective interaction. Challenges that blind individuals face daily, and how technology can truly make a difference.

What's next for AURA

Expanding AURA’s capabilities with multi-language support. Enhancing workplace integration with Microsoft Office, Google Docs, and Slack. Developing a mobile version for on-the-go accessibility. Partnering with education and workplace accessibility organizations to bring AURA to those who need it most.