NeoTutor — Live AI Whiteboard Teacher Powered by Gemini 3

Inspiration

Most AI learning tools feel like chatbots, not teachers. We wanted to bring back the feeling of a real classroom — where someone explains out loud, draws while teaching, and responds naturally to questions. NeoTutor was inspired by how people actually learn best: by seeing, hearing, and interacting at the same time.

What it does

NeoTutor is a live AI whiteboard teacher. Users enter a topic, skill, or goal, and Neo immediately starts teaching by speaking and drawing step-by-step on a whiteboard. Learners can interrupt with questions, view transcripts, and automatically receive notes. It supports quick topics, full courses, exam prep, interview practice, hobbies, and document explanations.

How we built it

We built NeoTutor using Gemini 3 for intelligent lesson generation and structured teaching responses. A web-based interactive whiteboard animates diagrams in sync with voice output, while the UI manages modes, notes, transcripts, and roadmaps. The system is designed to teach in short, human-like chunks for reliability and realism.

Challenges we ran into

The biggest challenge was making the experience feel truly “live” — synchronizing voice, whiteboard animation, and interaction without delays or blank screens. We also had to design safe fallbacks when live APIs or quotas were unavailable, ensuring the demo always worked.

Accomplishments that we’re proud of

Built an AI that teaches, not just chats

Real-time whiteboard animation synced with explanations

Interruptible, human-like learning flow

Automatic notes, transcripts, and study structure

What we learned

Great AI experiences are about interaction and clarity, not just model power. Reliability, pacing, and visual feedback matter just as much as intelligence.

What’s next for NeoTutor — Live AI Whiteboard Teacher Powered by Gemini 3

Next, we plan to add collaborative classrooms, deeper assessment tools, and adaptive long-term learning paths — making NeoTutor a full personal AI teacher for anyone, anywhere.

Built With

• downloadable
• for
• generation
• javascript-frameworks-&-libraries:-next.js-(app-router)
• pdf
• react
• roadmaps)
• structured-teaching-output)-whiteboard-&-visualization:-tldraw-/-excalidraw-(interactive-whiteboard-animations)-voice-&-interaction:-browser-speechsynthesis-(text-to-speech)
• study
• tailwind-css-ai-&-apis:-google-gemini-3-api-(lesson-generation
• technologies-used-languages:-typescript
• transcripts
• utilities:
• web-speech-api-(speech-to-text)-cloud-&-platform:-google-ai-studio-/-gemini-api-storage:-browser-localstorage-(notes