LectureSync

Inspiration

We wanted to help students with hearing issues and international students.

What it does

AI note app / voice notes / translation + youtube notes

youtube notes -> localhost:3000/youtube or https://storm-hacks-2024.vercel.app/youtube

How we built it

chatgpt, vercel for deployment

Challenges we ran into

• merge conflicts / random git errors
• vercel ai sdk streaming issues
• getting the tts to play ( doesnt work in prod cause vercel function invocation timeouts )
• vercel function invocation timeouts
• domain names are 15 dollars

Accomplishments that we're proud of

• streaming llm responses was cool
• able to format markdown nicely
• being able to use text to speech to play back the note we created

What we learned

• vercel ai sdk
• deepgram api
• openai tts
• anthropic claude api

What's next for LectureSync

• host the text to speech portion on a seperate vm cause vercel function invocation timeouts
• mobile app
• pause button for read out loud feature
• folders
• being able to save notes

Built With

• anthropic
• deepgram
• nextjs
• openai
• tailwdincss