Snap2Learn

Impactful Learning in Every Snap.

Comment

Snap2Learn

🧠 Inspiration

We inspired from traditional learning methods that often fail to capture the attention of today’s learners, especially in under-resourced or culturally diverse environments based on Programme for International Student Assessment (PISA) study about Indonesia’s literation, numeration, and science peformance. Our team recognized the potential of combining computer vision with generative AI to create a tool that supports active learning using images taken from a user’s own environment.

📸 What it does

Snap2Learn is an AI-powered app that turns real-world photos into interactive microquizzes.

It uses:

  • YOLOv8 for object detection
  • Gemini API for generating educational content
  • Flutter for the mobile interface
  • ASP.NET (C#) backend

Users take a photo, and the app detects objects and generates related quiz questions and explanations, turning the environment into a dynamic learning space.

🛠 How we built it

  • Frontend: Flutter
  • Backend: ASP.NET (C#)
  • Image Processing: YOLOv8 for object recognition
  • AI Content Generation: Gemini API to create quiz questions and explanation summaries

🧗 Challenges we ran into

  • Real-time integration between object detection and content generation
  • Ensuring quiz relevance and educational value
  • Managing latency between services
  • Designing a smooth and intuitive user experience

🏆 Accomplishments that we're proud of

  • Built a working prototype that converts photos into quizzes
  • Achieved smooth integration across multiple technologies
  • Created a fun and engaging learning experience
  • Supported SDG 4: Quality Education

📚 What we learned

  • How to combine vision models with language models effectively
  • Strategies for designing impactful educational tools
  • Importance of user engagement in learning apps
  • Building cross-stack applications under time pressure

🚀 What's next for Snap2Learn

  • Use a more advanced AI model
  • PvP between players
  • Multilungual Support

Built With

Share this project:

Updates