Eucalyptus

Logo
Landing Page
Choosing Audio File

Inspiration

Due to the recent pandemic, education has had to make the shift to online learning. All classes, at all grade levels, have had to turn to online substitutes for something that is so very important. During our Zoom meetings and lectures, we were often given audio files to listen back to important information that we may have missed. Going through one to two hours' worth of content again can be very tiring, which is why we tried to simplify the process using Google Cloud.

What it does

Eucalyptus is an application that allows users to send in audio files of meetings and lectures to get them easily transcribed and structured.

Our mission is to help ease student and employer life by using AI to transform and easily summarize meetings and lectures that they were not able to understand.

This brought us to the idea of using Google Cloud and AI to autogenerate a transcript of the meeting and format it so users can read through the content easily. Google Cloud allows us to transcribe the audio files and AI allows us to format and summarize the content into logical breaks.

How we built it

We built the front-end using React.js and JavaScript. The back-end was built using Flask and Python.

We used the Google Cloud to transcribe the audio files that were sent in by the user on the front-end.

After the transcript is received, we use TensorFlow to understand the discussion that happened and return a formatted and summarized text for the user to see.

Challenges we ran into

We ran into a lot of challenges when trying to implement the speech to text conversion. The API documentation was not as clear as we had liked and there were many hoops we had to jump through to try to make it work. Additionally, we had problems writing the NLP algorithm to try to organize the transcript that is provided into main ideas with headings for each.

Accomplishments that we're proud of

We are proud of being able to put together a front end that looks visually appealing as well as functional. We are also proud of being able to write an algorithm to classify text that was provided.

What we learned

We learned a lot about how NLP works and about working with APIs that were provided to us by Google.

What's next for Eucalyptus

Our goal for the future is to scale our project to work directly in conjunction with zoom meetings. We want to do this to increase ease of use for students worldwide.