While many of us are benefiting from the convenience of taking notes on an electronic device after a long period of remote study, not everyone can afford an iPad or a monitor.
Taking digital notes while watching online recordings on one screen can be frustrating at times when you have to constantly switch between the note-taking tab and video tab. We aim to provide a tool that avoids this clunkiness and ultimately improves student’s productivity.
What it does
It automatically generates a summary of the video and it can also send you a link with the time stamp if you would like to jot down a particular time of the video to go back to in the future. It liberates you from the trouble of manually taking notes and copying the link for the time stamp. The two functions are currently separate but they are expected to be combined in the near future.
How we built it
We used a YouTube Transcript API (https://github.com/jdepoix/youtube-transcript-api) to get the transcript of the video. We then used Luhn Summarization algorithm implemented in the Sumy library to pick out sentences in the transcript that best reflect the main topics of the whole video.
Challenges we ran into
Accomplishments that we're proud of
We are able to try out different machine learning algorithms and compare their performances tailored to our own needs.
What we learned
We learned about the NLP task of text summarization, how to use an RPC, and much more.
What's next for IntelliNote
Most importantly, we will be integrating the two functions.
Video: Show the process → talk about future steps
We are also seeking to expand the range of videos we can handle from those with transcripts that have punctuations to those with captions that don’t have punctuations, even to those without captions at all.