Inspiration
We often struggle to pay attention in class when the material is just too boring. Even though we have to go to class, we don't seem to learn anything. Notacrates is there to help you take notes on your lecture with just a click of a button.
What it does
You can record the lecture and it will provide you with the transcription and notes based on the lecture.
How we built it
We started off by utilizing OpenAI to generate lists of key concepts and ideas from text transcripts of speeches to help refine our idea of how it would be able to generate notes. Then, we developed a webpage that allowed for audio recording, as well as incorporated speech recognition. From here, we passed in the text version of the speech to OpenAI for processing.
Challenges we ran into
We utilized a more robust speech recognition software in the earlier stages of our project that needed to be scrapped due to the inconvenience of using it.
Accomplishments that we're proud of
We were able to provide an audio file to our program to return an accurate transcription of what was being said through the use of the OpenAI Speech-to-Text API. With the transcription file, we were able to summarize and list key ideas from the transcript and display them on our website so that the user can utilize them however needed.
What we learned
We learned to manage the scope of the project. We also learned how to incorporate open source programs such as PyDub to help us with the process of transcribing the audio. We also learned how to successfully connect the front end consisting of html, css, and javascript to the backend consisting of python.
What's next for Notacrates
In the future, we will want to provide increased options apart from the notes that we will share with the user. Eventually, we will also want to provide a downloadable file with the notes and the actual transcript as well. Also we would want the user to select if they want additional resources shared with them.
Built With
- api
- css
- flask
- html5
- javascript
- openai
- python
Log in or sign up for Devpost to join the conversation.