Inspiration

My inspiration came from watching "Sitaare Zameen Par" movie, which reminds that every child learns differently and deserves patience, understanding, and the right opportunities to grow. We wanted to create a world where learning feels exciting rather than stressful, especially for children who face learning difficulties.

What it does

Lumora is an AI-powered, gamified learning-support platform for children aged 5–12, including children with neurological and learning difficulties. Through five magical worlds, children develop foundational skills using computer vision, hand tracking, voice interaction, and interactive games.Lumora also helps parents and teachers notice learning difficulties or areas where a child may need additional support, especially when the child struggles to express or communicate those challenges. It provides learning-progress insights and recommendations so adults can better understand each child’s needs and support them early.Lumora is designed for learning support and early identification of possible difficulties—not medical diagnosis.

How we built it:

We built Lumora using React, Vite, JavaScript,Codex, computer vision, hand tracking, speech recognition, and adaptive learning logic. We designed five magical learning worlds focused on skills such as phonological awareness, reading, visual attention, motor skills, number sense, and memory.

Challenges we ran into:

1.Making real-time hand tracking work smoothly. 2.Integrating camera and microphone interactions into gameplay. 3.Creating engaging games that support different learning needs. 4.Balancing magical visuals with accessibility and performance. 5.Building a functional MVP within a limited timeframe.

Accomplishments that we're proud of:

1.Created an interactive learning world instead of a traditional educational platform. 2.Integrated computer vision, voice interaction, and gamification. 3.Designed five unique worlds for different foundational skills. 4.Built a platform that can support both typically developing children and children who need additional learning support. 5.Deployed a publicly accessible MVP.

What we learned

Learned about computer vision, pixeled UI.

What's next for Lumora

We want to improve real-time hand tracking and voice interaction, expand adaptive learning, strengthen parent and educator dashboards, add more accessibility features, and conduct structured user testing to understand how Lumora can better support different learning needs.

Built With

  • ai
  • claude
  • codex
  • computervision
  • gamifiction
  • hand-tracking
  • react
  • speechrecognition
  • typescript
  • vite
Share this project:

Updates