Inspiration
Our team member Rishab, was doing physics, and found it very difficult to use a calculator. So, in his typical manner, he decided to overengineer and sought out a way to convert handwritten notes to algebraic equations. ScriptIO is our first baby step towards that reality.
What it does
Currently, ScriptIO takes in an image of handwriting, and then outputs the converted text.
How we built it
We used Google Cloud to detect text in images of handwriting using its computer vision capabilities. Our project is powered by Spring Boot, with a MongoDB backend, and our frontend uses JS/HTML/CSS/Bootstrap. We used Git for version control.
Challenges we ran into
The main challenge was making all of the components of the model interface properly with Spring Boot. We also had to learn many of the technologies we learned from scratch, such as CSS/Bootstrap, JS, and MongoDB.
Accomplishments that we're proud of
We are proud that our project successfully converts images of handwriting into text accurately. We are also proud that we were able to use and implement so many new technologies.
What we learned
The things we learned include a better understanding of machine learning and OCR, non-relational databases, frontend and backend development, general system design, and version control.
What's next for ScriptIO
We want to be able to store the documents that users create. We also want to improve how our website handles the digital handwriting. Finally, we would like to improve the model to be more tailored by user.
Log in or sign up for Devpost to join the conversation.