RecapHacks

Main page of the site
Inputting a youtube link into the box
The page that shows all the output

Inspiration

When we began to learn about the AssemblyAI API, the features and the impressively extensive abilities of this API had us wanting to do something with audio transcription for our project.

What it does

Our project is a web app that takes in a URL link to a youtube video, and generates a text transcription of the english spoken words in the audio of that youtube video. We have an additional functionality that can summarize the text transcription, keeping the most important points of the transcribed text.

How we built it

The backend functionality is all done in python using AssemblyAPI, the process is as follows:

A youtube link is sent to the script via the website
The corresponding youtube video's audio track is fetched
The audio track is analyzed and transcribed using AssemblyAPI
The transcribed text is outputted

And for the summarization functionality:

A large string is inputted to the summary script
The script uses the nltk librairy to help generate a summary of the inputted text
The summary is outputted

The website is developed using NodeJS with a ExpressJS framework. We developed interaction functionality so that the user could input a youtube link to the website and it would communicate with our backend scripts to achieve the results we wanted.

Challenges we ran into

Learning AssemblyAPI was fun, but figuring out how to call and specify exactly what we wanted turned out to be a challenge in and of itself. Another challenge we ran into was around halfway through our development process, we had a lot of scripts that all did different things, and we had to figure out how to best link them together to end up at our desired functionality. Making the website function was a huge task, and mostly taken upon by one of our team members with the most experience in the area.

Accomplishments that we're proud of

The overall look and design of our webpage
The way our backend scripts work together and work with the AssemblyAI API
The website's functionality
Figuring out that one thing that was wrong with the configuration on one of our team member's computers that wasted ~3-4 hours.