Inspiration

We often take notes by hand in class, or have large PDFs of text that we wish we had time to read.

What it does

StudyBuddy takes your notes, whether it is a PDF or an image, and converts it to text and extracts the key phrases for you in a convenient flash card format. It works on both printed and handwritten text input. It also returns a PDF that highlights the lines containing the key phrases.

How we built it

We used the Microsoft Azure Computer Vision API for extracting text with OCR and the Microsoft Azure Text Analytics API to get the key phrases.

Challenges we ran into

We initially wanted to convert handwritten text and generate LaTeX for it, and we tried to use OpenCV for it, but learned that a lot of math symbols are not easily recognized by OCR.

Accomplishments that we're proud of

We can convert images of our notes to text :)

What we learned

Using the Microsoft Azure APIs, and building a web application with Flask

What's next for StudyBuddy

We would like to be able to extract mathematical formulae from handwritten text and generate LaTeX

Built With

Share this project:

Updates