\documentclass[11pt,a4paper]{article} \usepackage[utf8]{inputenc} \usepackage[T1]{fontenc} \usepackage{lmodern} \usepackage[margin=1in]{geometry} \usepackage{titlesec} \usepackage{parskip} \usepackage{hyperref}
\title{\textbf{EducateAI}} \author{} \date{}
\begin{document}
\maketitle \vspace{-2em}
\section*{Inspiration} Everyone in our group has taught maths and come across the same issues: no all-in-one platform and no assistance when we are lost for words! This is where EducateAI comes in. We took inspiration from various online whiteboards, identified gaps when it comes to video capabilities, and turned proactive feedback into reactive information.
\section*{What it does} EducateAI allows the tutor and tutee to collaborate on a shared whiteboard while integrating live video and audio calling. We interpret facial expressions, tone, transcripts, and the whiteboard itself to come up with real-time feedback and datapoints that the tutor can then act on to deliver a quality session! We also have a post-session catch-up, with an AI-generated summary and chat feature to help improve for future sessions.
\section*{How we built it} We built it from the ground up, creating our own custom whiteboard and voice/video call website using React, Vite, WebRTC, and Django Channels (Daphne ASGI). We then expanded it to collect relevant data, parsing it into usable streams. Next, we fed these streams into various models and pipelines (Google Gemini, MediaPipe, and OpenAI Whisper) to get actionable data---some of which is reported straight back to the tutor in real time, and some of which is provided as feedback at the end.
\section*{Challenges we ran into} We had loads of issues along the way, our least favourite being terrible audio transcription! We spent hours trying to improve the transcription, and eventually solved it by reducing how much we chunked our audio data.
\section*{Accomplishments that we're proud of} We are proud of how responsive it is, and how it can mix and match different forms of inputs, resulting in coherent, accurate, and smart suggestions. We are also proud of how we timed the alerts so they do not interrupt while the tutor or tutee is actively explaining or talking about something.
\section*{What we learned} This was the first time any of us built something as a team, and the first time any of us really embraced AI. We drastically improved our teamwork and went from 0 to ``hero'' in Git. We were really impressed with Gemini and Antigravity, which was our group favourite, and how it could take an outline of a feature we had in mind and flesh it out to the point we were ready to let it implement it!
\section*{What's next for EducateAI} Next, we plan to get EducateAI in front of users and start using it in our own tutoring sessions. We keep zero persistent personal data about users, allowing us to dive straight into using it in the real world.
\end{document}
