SummAIze

Inspiration

We are a group of students looking to streamline the process of absorbing information. From summarising pdf lectures notes to video lectures, our AI powered note collation system helps students from all over the world condense high volumes of study materials in a matter of seconds. We wanted to make learning easier by building a huge database of notes from all over the world that can be condensed to make absorbing information easy.

What it does

Our application allows users to upload pdf, word document and video lectures which adds to the entire database of study content.

Video content will then be processed by splitting the audio from the video and running through Speech to Text which PDF documents is processed through Document AI's Optical Character Recognition (OCR). These processed content will then be passed through OpenAPI and summarised. A few Flash Cards will also be generated to utilise active recall and help students learn better.

Users can also Bookmark their favourite posts if they are logged in which allows them to come back to it in the future.

How we built it

We built this web application using Next.js and Tailwind CSS, utilising Google Cloud functions such as Document AI, Speech to Text and Google Cloud Storage to store video submissions. We also utilised OpenAPI to help summarise content and produce flash cards. Our user data and posts are stored in MongoDB.

Challenges we ran into

We ran into some problems splitting the audio from the video and running through Speech to Text. We also faced problems when uploading large files because the free version of MongoDB is quite slow.

Accomplishments that we're proud of

We are proud to have integrated multiple Google Cloud functions, being able to make use of modern technology to help reinvent note collation. I believe our project has the potential to pave the way to make learning easy especially with the generated flash cards and summary. Students can get a rough idea of the notes without having to read through a multitude of pages to get the gist of the notes

What we learned

We learnt that AI may not be 100% accurate but rather it is a tool to help make our lives easier.

What's next for SummAIze

For our possible future extensions, we would like to be able to partner with apps like Notion which acts as a personal database for each individual student, they would be able to upload the notes from the website straight there which provides a better platform for viewing notes and FlashCards.