Accessible Learning Assistant

1. 💡 Inspiration

• We wanted to create a tool that makes learning easy and fun for visually impaired students.
• Inspired by a vision to make education inclusive, interactive, and accessible for everyone.

2. 🎯 What It Does

• Transform Presentations:
  • Our app scans lesson presentations using OCR to recognize text and turn it into vector data.
• AI Conversations:
  • Users can have real-time, interactive chats with AI about the presentation topics!
• Retro-Style Quizzes:
  • After learning, users can take a fun, retro-style quiz to test their knowledge and solidify their understanding.

3. 🛠️ How We Built It

• Frontend: Built with Next.js for a responsive, accessible interface.
• OCR & Vectorization: Presentation content is vectorized and stored in a vector database.
• AI + NLP: Used LLM and LangChain to make conversations more meaningful, referencing both user and presentation data.
• Azure Cloud: Hosted on a secure, scalable Azure VM with FastAPI backend .
• Quiz Generator: Auto-generates quizzes using NLP for a fun, interactive learning experience .

4. 🏆 Accomplishments That We’re Proud Of

• Inclusive Learning: Empowering visually impaired students to engage in a whole new way!
• Real-Time AI Interaction: Made a real-time, contextual AI conversation tool that is truly interactive.
• Fun Quiz Design: Retro-styled quizzes make learning fun and engaging.
• Tech Stack Integration: Pulled together OCR, LLM, Azure, and vector search in one seamless app!

Built With

• ai
• azure
• llm
• nextjs
• python
• rag
• redbulls
• retro