-
-
Dashboard (camera, speech to text and ai chat bot)
Inspiration
Online and hybrid classrooms make it hard for teachers to know whether students are engaged. We wanted to bridge the gap between content delivery and classroom awareness by giving teachers real time feedback without disrupting the learning experience.
What it does
Our app is a real-time classroom platform that lets teachers instantly share slides and PDFs with all students while using computer vision to track participation and engagement. When a teacher selects a document, it synchronizes across all devices, ensuring everyone stays on the same page while providing live insights into classroom activity.
How we built it
We built the frontend using React and TypeScript, with a custom PDF carousel that renders slides as images for smooth, synchronized viewing. The backend is powered by Flask, handling file management, active document state, and API communication. We tried to integrated computer vision models using OpenCV and MediaPipe to analyze presence and engagement in real time.
Challenges we ran into
One challenge we faced was implementing real-time camera-based hand-raise detection using MediaPipe. While we successfully experimented with the model, integrating it reliably alongside live content synchronization proved time-consuming. We ultimately chose to pause this feature to focus on strengthening the core experience real-time slide sharing, synchronization, and overall system stability resulting in a more polished and dependable platform.
Accomplishments that we're proud of
We’re proud that we built a fully functional real-time system where teachers can control shared content and students automatically stay in sync. Integrating AI-based vision analysis alongside live document sharing gave the platform a unique and meaningful use case beyond simple screen sharing for students.
What we learned
We learned a lot about real-time systems, client-server synchronization, and working with computer vision in live applications. The project also taught us how important it is to design tools that support educators without adding extra complexity to their workflow.
What's next
Next, we want to improve engagement analytics, add user authentication and role management, and introduce real-time notifications using WebSockets. We also plan to expand accessibility features
Log in or sign up for Devpost to join the conversation.