Alexa, Take Notes

Inspiration

Seeing all the announcements in courses asking for volunteer notetakers.

What it does

Combines any available lecture material:

• Slides/Notes
• Audio/Video recording

into a comprehensive set of notes, well formatted in markdown

How we built it

Frontend - React, interface to download existing notes and interface to upload notes, recording.

Backend - Flask making API calls to AWS.

The services used are:

• S3, for storing the markdown
• Bedrock (Claude 3 Sonnet), generate combined markdown from audio transcript and image of notes
• Transcribe, for converting .mp3 or .mp4 -> text

Challenges we ran into

• Learning the ecosystem and making an efficient workflow
• Violated same origin policy for fetching from S3

What's next for Alexa, Take Notes

• PDF support
• More Prompt Engineering for better results

Built With

• amazon-web-services
• flask
• python
• react
• s3