Tutor.ai

Tutor.ai is a mobile AI learning assistant that transforms lectures into dyslexia-friendly, interactive content, helping neurodivergent students learn smarter, retain more, and thrive independently.

Comment

Inspiration

Traditional classrooms often fail to support neurodivergent students, especially those with dyslexia. Processing lectures, taking notes, and organizing information becomes overwhelming, despite their intelligence. We wanted to create an AI-powered solution that makes learning accessible, engaging, and empowering for every student.

What it does

Tutor.ai is a mobile-first AI companion that:

  • Captures real-time lectures and transcribes them
  • Summarizes content into dyslexia-friendly, visual formats
  • Converts whiteboard diagrams into structured notes
  • Gamifies learning with quizzes, achievements, and smart review schedules
  • Transforms online lectures (like YouTube videos) into accessible study materials
    All with full support for customizable accessibility features like fonts, colors, and reduced motion!

How we built it

  • Frontend: Built with React Native + Expo for cross-platform accessibility.
  • Backend Services: Integrated OpenAI APIs (Whisper for transcription, GPT-4 for summarization) and Google Vision API for visual processing.
  • AI/ML:
    • Real-time speech-to-text with speaker identification
    • Dyslexia-friendly summarization and content restructuring
    • Whiteboard and diagram analysis using computer vision
  • Design: Focused heavily on accessibility, customizable UI, and mobile-first experience.

Challenges we ran into

  • Achieving high transcription accuracy in noisy classroom environments.
  • Structuring summarized content in a way that balances simplicity and completeness for dyslexic learners.
  • Designing a UI that is both accessible and visually engaging without overwhelming users with cognitive load.

Accomplishments that we're proud of

  • Developed a fully working prototype that transforms live lectures into accessible, visual study guides.
  • Successfully integrated gamified learning elements to keep students motivated.
  • Optimized the app for neurodivergent users with customizable fonts, colors, and reduced-motion options.
  • Built a scalable, cross-platform architecture ready for future growth!

What we learned

  • Neurodivergent learners benefit immensely from multisensory, gamified, and highly visual study tools.
  • Building for accessibility from the ground up creates better, more inclusive products.
  • Seamlessly combining AI technologies (speech recognition, summarization, computer vision) unlocks powerful new learning experiences.

What's next for Tutor.ai

  • 📚 Collaborative Learning: Allow students to share notes and summaries with peers.
  • 🧑‍🏫 Educator Portal: Let teachers upload materials directly to students' apps.
  • 🌐 Offline Mode: Support offline lecture capture and summarization.
  • 🧠 Advanced Analytics: Personalized learning insights and progress reports.
  • 🛠️ Expanded Subjects: Add specialized tools for STEM, languages, and arts education.

Built With

Share this project:

Updates