Pick2Plan

Inspiration

When I started my MS in AI program at UM Dearborn this Fall 2024, I noticed that the professors and university staff upload the schedules for semester in a table format such as at what dates and time what classes will be conducted and what topic will be discussed. So if a student uses a Google calendar and he wants the whole schedule on his calendar they will have to add event multiple times, so for them I wanted to create an agent that helps add all the events in one go. That's when we had the idea of Pick2Plan!!

What it does

Pick2Plan basically lets a user upload the image or screenshot of the table of schedule he wants in his calendar. Lets the user extra details in chat that he would like for additional context for the events to be added. After that it extracts the text data from the image, understand the individual event titles, dates, timings, etc and creates those events on the google calendar of the user.

How we built it

We used Python, pytesseract, OpenCV, uagents, Fetch ai, in the backend, JavaScript for the frontend, Google Cloud Platform and Google Calendar API for event creation.

Challenges we ran into

We struggled a bit for Google Calendar API usage and to create an agent which can properly understand the text in the image.

Accomplishments that we're proud of

We are proud of how instantly we were comfortable with each other when the team was formed on the spot. How effortlessly we understood our roles in the team and collaborated with each other and solved each other doubts easily. We are proud that the students, mentors and workshop speakers liked our project idea.

What we learned

We learned the potential of Google cloud platform, Fetch AI, Gemini and Google's aistudio. We learned how ahead some companies are in the game of AI. We learned about many different and interesting project ideas.

What's next for Pick2Plan

We plan to increase its use cases for not only scheduled timetables but also, movie tickets, travel tickets, doctor visits prescriptions, appointments. It can have an additional feature where a user can create calendar events for multiple other users which can be useful in friend groups, office teams and study groups. Overall, Pick2Plan has the potential to not only be a useful extension for university and office platforms but also be a integrated solution across multiple apps where just a normal conversation of a meeting or hangout being confirmed for a user can create an alert for him if he wants to add it to the calendar or any other personal scheduler he wants.