Sam AI Buddy

• 

  Once download of the notes is completed.

• 

  Landing Page.

Inspiration

A will to create a tool for other students and teachers and help them with work that AI can do in seconds. From creating study material, review guides, or notes from lecture recordings, Sam is your academic AI support buddy.

What it does

Sam is your own custom GPT that summarises any PDF Document you give it. It also takes in lecture files, converts it into text and gives a detailed summary to add to your notes.

How we built it

Technologies used: Python, HTML, CSS, Javascript, Flask, Langchain Our project involves the development of a custom GPT model tailored to summarizing lecture audios and PDF files. To achieve this, we utilized OpenAI's Whisper model for converting user-provided MP3 files into text format. Then, I implemented a process to segment the text file into chunks, which were then stored in a vector database to enable efficient searching through the LangChain framework. Additionally, I established a summarization chain employing map-reduce techniques, ensuring that each chunk of information was succinctly summarized to provide relevant outputs.

Challenges we ran into

While trying to use the langchain frameworks, I had to deal with outdated documentation and unforeseen errors due to which majority of time was spend on debugging. I had no prior experiencer of full stack so it was challenging to incorporate back end with front end and make a working project in the span of 24 hours. Also, File Handling can be a task in such projects.

Accomplishments that we're proud of

Fully running AI application

What we learned

We learned the intricacies of how to train LLM models on custom Data. I learned how to create and query vector databases, feed in chunks of data and connect LLM to our search query to product a natural language response.

Further more i learned how to connect back-end code to front-end and make a complete web application.This hands-on experience not only broadened our technical capabilities but also empowered us to tackle complex challenges in future projects with confidence.

What's next for Sam AI Buddy

We want to add PDF search capabilities, where user will be able to ask questions about the PDF and get accurate answers. Furthermore, we would like to make a tool for teachers to create quizzes out of the PDFs, and auto grade them.

Built With

• css
• databases
• flask
• html
• javascript
• langchain
• openai
• python
• vector