Inspiration
💡 Inspiration Millions of people face daily digital barriers due to hearing or vision impairments. We wanted to build a unified platform that uses AI to make the web more accessible and communication more inclusive.
What it does
🚀 What it does LinK is an AI-powered accessibility platform that offers: An interactive ASL learning hub AI-generated image alt-text (via Google Gemini) OCR text extraction for screen readers Natural voice synthesis (via ElevenLabs) Hands-free voice navigation WCAG-compliant UI with responsive and keyboard-accessible design
How we built it
🛠️ How we built it Frontend: React + TypeScript with full ARIA & WCAG compliance Backend: Node.js + Firebase for auth and data persistence AI Integrations: Google Gemini for image understanding ElevenLabs for TTS Hugging Face Transformers for OCR Voice Navigation: Vosk + Web Speech API Built with modular architecture to support scalable agent features
Challenges we ran into
⚔️ Challenges we ran into Ensuring full accessibility compliance while maintaining a smooth UX Integrating multiple AI APIs with consistency and low latency Voice navigation accuracy across noisy environments Handling OCR edge cases for low-resolution or stylized text images
Accomplishments that we're proud of
🏆 Accomplishments that we're proud of Created a fully functional ASL education system with progress tracking Implemented AI alt-text generation that performs better than static captions Built a unified tool that serves both the Deaf and Blind communities Delivered a sleek, responsive, WCAG-compliant app ready for real-world use
What we learned
📚 What we learned Deep understanding of accessibility standards (WCAG 2.1 AA) How to integrate diverse GenAI tools into a cohesive frontend Importance of UX empathy in designing for real-world accessibility needs Balancing performance with heavy AI processing
What's next for LinK
🔮 What's next for LinK Add real-time sign recognition using MediaPipe Expand language support for non-English users Mobile-first app release Partner with NGOs and educational institutions for real-world deployment Open-source release with contributor onboarding guide
Log in or sign up for Devpost to join the conversation.