NotCookedChat

Inspiration

The inspiration was us going to YouTube and other lecture videos to study and understand better. Then came the thought, maybe if we can pause the video whenever we want and have a summary, a quiz, and a chat with an AI about it. This is a big step toward making learning and studying better and more interactive for students. It is removing all confusion out of the window.

What it does

This extension pops up every time you pause your video, and presents you with a summary, a quiz and a chat with an AI about the video portion watched. You can also upload a video/audio and get the same result.

How we built it

By using the great tools and sponsors provided to us, we built this project with the Snowflake API and ElevenLabs. Python for the backend with SQL, and finally, JavaScript and CSS for the frontend of the extension. The content of the video is being taken from the captions or speech-to-text, with the help of ElevenLabs. This is being sent to the Snowflake API to generate the summary and quiz. Also, ElevenLabs' Agent is in the chat to answer any questions based on the given content.

Challenges we ran into

Some of the challenges that we ran into were the capture of the content of the video from YouTube. There are many policies and rules to be aware of and make sure not break. Therefore, we used ElevenLabs as well for help. The use of ElevenLabs was new to us, so we tried our best, with its helpful tools and learning how to use them.

Accomplishments that we're proud of

We are extremely proud of the outcome of the quizzes and chat, where the viewer of the video can deepen their understanding and learn better.

What we learned

During this hackathon, we learned a lot as a team. We used the Snowflake API and ElevenLabs for the first time. We successfully made a working extension for the first time as well.

What's next for NotCookedChat

NotCookedChat should and will be on every student's laptop, and used every night before an exam for help and success. NotCookedChat can be scaled and become a web app with all features and improvements.