Inspiration
This application was created for the sake of convenience and organization of digital calendars. As even though calendars can be accessed from our phones, tablets and watches. It doesn't help us much at all if we forget to put it in, or put in the wrong label/information.
What it does
What's Next? is an application created out of the desire for pure convenience. Using the camera on your phone or smart device, the picture will be sent to the app where it will be processed and automatically added to the user's to-do list on Notion.
How we built it
This project was split into 3 main portions: dealing with machine learning, processing out inputs, and adding the data to the Notion page. The first was accomplished by using OpenCV's handwriting recognition capabilities and further training that model with Tesseract. Next, the text obtained from our model would be checked with regular expressions to see if the image contained a date and an event. Regex was used specifically so that we could get dates in several formats easier. Finally, the Notion API and database capabilities were used to add the date and event to a table embedded on a notion page.
Challenges we ran into
We actually ran into quite a few issues getting the API keys to work and also ended up switching calendars around from Google Calendar API and Cloud Vision API, to Notion, OpenCV and Tesseract. Additionally, the actual training of the model took up a bit more time than we would have liked, but hey that was an expectation from the start.
Accomplishments that we're proud of
Actually being able to recognize the text and classify it on real images was really cool. In the past when we tried to use machine learning it never got to the point that it worked.
What we learned
To look at if the Google API thing you are using has a free version, and what constitutes "free."
What's next?
Personally while we do have this being put into a todo list right now in notion we would like to expand functionality to the google calendar API. Additionally if we could naturally implement a "snipping" like tool for webpages and messages that would be pretty cool.
Log in or sign up for Devpost to join the conversation.