Smart Code Buddy — Multimodal Code Explainer & Fixer

🧠 Smart Code Buddy — Multimodal Code Explainer & Fixer

Smart Code Buddy is an AI-powered developer assistant that helps beginner developers understand, fix, and test code using Gemini 3 multimodal reasoning.

It works with both pasted code and screenshots of code, making it especially useful when code is shared as images, error screenshots, or poorly formatted text.

💡 Inspiration

Many beginner developers struggle when:

They don’t understand error messages

Code is shared as screenshots

Existing tools explain issues in complex language

We wanted to build a tool that:

Explains code in simple language

Works with real-world inputs like screenshots

Helps beginners learn while fixing bugs

🚀 What It Does

Smart Code Buddy allows users to:

Paste code or upload a screenshot of code

Automatically extract code from images using OCR

Analyze the code using Gemini 3

Get:

Simple explanation of what the code does

Detected bugs and warnings

Step-by-step fix instructions

Copy-paste ready patch/diff

Automatically generated unit tests

🧩 Challenges We Ran Into

Extracting clean, readable code from screenshots

Ensuring AI responses are always structured and reliable

Balancing powerful features with a beginner-friendly UI

Combining AI suggestions with deterministic static analysis

🏆 Accomplishments We’re Proud Of

Built a new application specifically for this hackathon

Successfully used Gemini 3 multimodal capabilities

Combined AI reasoning with static analysis for higher trust

Created a clean, public, and stable demo

Designed the app specifically for beginner developers

🔮 What’s Next

Support for more programming languages

GitHub pull request generation

VS Code extension for real-time usage

Advanced OCR and streaming AI responses

Built With

• eslint
• express.js
• githubactionci
• jest
• monacoeditor
• node.js
• react
• tailwind
• tesseract.js