Inspiration

Millions of students struggle to learn coding because it feels confusing, intimidating, and heavily dependent on English-based resources. Many high school and first-year students, especially from rural and semi-urban areas, lack access to proper mentorship.

We wanted to build an AI-powered coding mentor that feels like a personal tutor — one that explains errors simply, adapts to learning pace, supports local languages, and turns frustration into confidence.

What it does

CodeBuddy AI is an AI-powered personalized coding tutor designed for beginners.

  • 💻 Provides an interactive coding playground
  • 🧠 Explains errors in simple, beginner-friendly language
  • ✍️ Converts handwritten notes into executable code
  • 🎯 Follows a structured zero-to-hero curriculum
  • 🎧 Offers voice-based explanations in Indian languages
  • 📊 Tracks progress and adapts difficulty dynamically

Future AI Enhancements

  • Weak topic detection
  • Personalized quizzes
  • Adaptive learning paths
  • Smart revision reminders
  • AI-generated performance insights

How we built it

Frontend

  • React 19
  • TypeScript
  • Tailwind CSS

AI & Intelligence Layer

  • Gemini Flash for chatbot, debugging, and explanations
  • Gemini Vision for handwriting-to-code conversion
  • Gemini TTS for personalized voice tutor
  • RAG pipeline for curriculum-aligned responses

We integrated AI directly into the learning flow instead of making it just a chat assistant.


Challenges we ran into

  • Designing beginner-friendly error explanations instead of generic compiler outputs
  • Making AI responses curriculum-aligned rather than random
  • Ensuring session-based personalization without heavy backend complexity
  • Balancing AI intelligence with fast performance for mobile users
  • Making explanations simple for non-English medium students

Accomplishments that we're proud of

  • Built a structured AI-guided coding experience instead of a basic chatbot
  • Successfully implemented handwriting-to-code conversion
  • Created smart debugging explanations tailored for beginners
  • Integrated voice-based learning support
  • Designed a scalable roadmap for deep AI personalization

What we learned

  • AI is most powerful when embedded into workflow, not just added as chat
  • Beginners need structure more than information
  • Personalization increases motivation and retention
  • Simplicity in explanation is harder than complexity
  • Building for real-world impact requires understanding user pain deeply

Vision

CodeBuddy AI aims to democratize coding education by making personalized AI mentorship accessible to every student with a smartphone.

Built With

  • debugging
  • gemini-tts
  • gemini-vision
  • google-gemini-flash
  • node.js
  • react-19
  • react-markdown
  • retrieval-augmented-generation-(rag)
  • tailwind-css
  • typescript
Share this project:

Updates