Inspiration
The main inspiration behind this project comes from our own experience. Not only as university students but as passionate self-learners, it is a universal experience to, at times, find it confusing to understand new concepts, particularly in class. Therefore, we thought about creating a personal Teaching Assistant that can support students worldwide, making this process easier. This is how LectureMe came alive.
What it does
The primary use of LectureMe is to record, summarize lectures and assist in clearing up doubts about them, such as answering questions about the content. Added functionalities include a chatbot to answer general academic queries and an audio recorder that saves the audio file on your local machine.
How we built it
Audio recorder and downloader: Javascript Speech-to-text feature: Python using Google Speech-to-text API Summarizing and answering queries: Python using Google PaLm API with Google Cloud Web design: HTML, CSS
Challenges we ran into
The first challenge we ran into was interfacing the Google Speech to Text with machines as we had a lot of package and dependency issues, but we overcame it using AssemblyAI's Speech to Text model. Subsequently, we had problems connecting the replies with the Google paLm chatbot API responses to the front end and had a hard time trying to implement multi-threading in our application to allow for real-time speech-to-text conversion.
Accomplishments that we're proud of
We are proud that we could submit a project with the features we desired. We were able to realize the vision we had for the project and learn the necessary skills to achieve this result. Overall, we are content with the completion of our project, and this hackathon.
What we learned
The hackathon was a memorable experience for us and it undeniably has been full of learning moments. First, we gained significant exposure to using APIs, particularly Google APIs like Speech-to-text, PaLm, and Gemini. We also further developed our existing coding skills through mutual teaching and online research which this hackathon motivated us to do.
What's next for LectureMe
We believe LectureMe is scalable to make the world a more accessible place through knowledge and efficiency. Right now, the website caters mostly to students and self-learners. It could be further scaled to make lectures more accessible to people with hearing or visual impairments. We also feel like our project could fit the business world, where meetings could use LectureMe to catch up independently on meetings that they could not attend.
Log in or sign up for Devpost to join the conversation.