TouchLearn-AI: Transforming Accessibility and Learning for the Visually Impaired
Inspiration
The global visually impaired community, comprising over 285 million individuals, faces limited access to educational resources. Traditional Braille systems are expensive and lack real-time adaptability, especially for complex subjects like math and handwritten materials. Inspired by the need for inclusivity and empowerment, we developed TouchLearn-AI to bridge this accessibility gap.
What it does
TouchLearn-AI is an AI-powered solution that transforms printed, digital, and handwritten educational materials into Braille in real-time. It integrates cutting-edge features like handwriting recognition, audio narration, and multi-language support. By connecting with Braille printers and refreshable displays, TouchLearn-AI ensures seamless, offline-enabled learning for visually impaired individuals worldwide.
How we built it
- Technologies Used: Python, TensorFlow, OpenCV for OCR and AI model development, and Google Cloud for multilingual translation.
- Hardware Integration: Interfaced with Braille printers and refreshable displays for real-time conversion.
- User Interface: Designed an intuitive, voice-guided interface for effortless navigation.
Challenges we ran into
- Ensuring high accuracy for handwriting recognition, especially for varied handwriting styles.
- Building multi-language support to cater to diverse linguistic needs.
- Seamlessly integrating hardware while maintaining cost-effectiveness.
Accomplishments that we're proud of
- Successfully implemented real-time Braille conversion for handwritten notes.
- Developed a robust, offline-enabled solution, making it accessible even in remote areas.
- Created a user-friendly interface tailored to the needs of visually impaired users.
What we learned
- The importance of iterative testing with real users to improve accessibility features.
- Advanced OCR techniques for better accuracy in text and handwriting recognition.
- Effective ways to balance affordability with high-end technological features.
What's next for TouchLearn-AI
- Expand support for regional Braille codes and languages.
- Enhance handwriting recognition to include complex equations and diagrams.
- Build a cloud-based accessible library for educational content.
- Collaborate with NGOs to scale deployment and reach underserved communities.
- Introduce gamified learning to make Braille education engaging and fun.
Built With
- Programming Languages: Python, JavaScript
- Frameworks: TensorFlow, OpenCV
- Platforms: Google Cloud, Raspberry Pi
- APIs: Google Translate API, Speech-to-Text API
- Databases: Firebase
- Hardware: Braille printers, Refreshable Braille Displays
Built With
- amazon-web-services
- css
- docker
- flask
- google-cloud-vision-api
- html5
- javascript
- liblouis
- mongodb
- opencv
- postgresql
- python
- react-native
- tensorflow
Log in or sign up for Devpost to join the conversation.