Inspiration
As computer science students from Mexico and India, we have seen underserved communities where classrooms depend on passionate volunteers who may not have formal training in every subject they are asked to teach. Ethan has witnessed similar challenges in India, where teacher shortages and limited resources can leave students without consistent access to qualified instruction.
These experiences inspired us to build Teacher Brain. Our goal is not to replace teachers, but to extend high-quality educational support to classrooms where trained educators are scarce or overwhelmed.
What It Does
Teacher Brain is an independent, multilingual classroom assistant. Using a local camera and microphone, it recognizes when a student raises their hand, identifies their seat from a teacher-defined seating plan, invites them to speak, and understands their question.
It provides an age-appropriate explanation in the student’s language and creates an engaging visual diagram for the classroom display. After answering an interruption, it returns to the original lesson instead of starting over.
How We Built It
We combined:
- RTMW pose detection for deliberate open-palm hand raises
- Local Whisper for classroom transcription
- OpenAI for pedagogical reasoning
- ElevenLabs for natural speech
- A validated visual system for child-friendly diagrams
- Teacher-defined student profiles and seating positions
- English and Spanish language support
Media remains ephemeral by default, and the system records learning evidence rather than permanent labels about students.
Challenges We Faced
Our biggest challenges included:
- Transcribing speech accurately in noisy classrooms
- Preventing the microphone from hearing the tutor’s own voice
- Reducing false hand-raise detections
- Supporting interruptions without losing lesson context
- Creating readable visual explanations with low latency
- Returning smoothly to the original lesson
What We Learned
We learned that effective classroom AI requires more than producing a correct answer. It must listen carefully, explain its reasoning at the student’s level, adapt to language, use visuals effectively, and preserve the flow of the lesson.
Teacher Brain is our attempt to help every student receive a patient, responsive explanation—regardless of their language, location, or access to trained educators.
Log in or sign up for Devpost to join the conversation.