Inspiration

Many members of our generation struggle with their attention spans, which can make adequately preparing for exams especially hard. Short-form, "TikTok brainrot" content is specifically designed to maximize dopamine in a short time period, which is engaging and rewarding when applied to studying and academics.

What it does

Take in a user input (text, YouTube video, lecture audio) and extract the most important subtopics, compiling these subtopics into a series of distinct short-form (TikTok brainrot-style) videos depicting Peter and Stewie Griffin from Family Guy comically discussing the subject matter. This is then followed by a short-form quiz, ensuring our users can both gain a fundamental understanding of the subject matter and test their knowledge in real-time, all while being thoroughly entertained by Family Guy antics.

How we built it

We used Gemini's API to extract transcripts from audio and text and a YouTube MP3 API to handle YouTube links. We then use the ElevenLabs API & voice cloning features to create audio files for the dialogue. We combine the audio files, an entertaining background video, and any overlay desired (captions and images of Stewie and Peter depicting their emotions) to create a final video, which is stored in an S3 bucket and serviced using a FastAPI/PostgreSQL backend and React frontend.

Challenges we ran into

We ran into some issues related to styling and seamless video playback, which were mitigated using lazy loading to make the finished product as close to scrolling TikTok or similar apps as possible. We also ran into some errors with the complex backend pipeline logic with so many moving parts, but ultimately got our application working fully as intended for all input types.

Accomplishments that we're proud of

We were proud to have learned how to use an assembly line video encoder (ffmpeg) and create a fully functioning web application in a field we had never worked with before.

What we learned

We learned how to create a modular, durable pipeline combining numerous different libraries and technologies to ensure smooth video generation, and learned a ton about how ffmpeg and video creation using code works in general, since none of us had used it before.

What's next for EduRot

We would love to add a social feature where users can share and like others' study videos, and potentially even view study guides generated by their classmates in the same courses at their high school or university.

Share this project:

Updates