Scaney Money

Inspiration

Coming into the hackathon, we knew we wanted to do a computer vision project since our team primarily has experience with machine learning and data science. When we heard about Capital One's topic, we came up with the idea to make handling money more accesible for vision impared peoples and support businesses who deal primarily with paper money.

What it does

Our project is an app that can be run as part of a cash register system. There are two buttons, input and output, that signify money going in and out of the register. Everytime each button is pressed, the object detection model trained for bills and coins is run and detects the dollar amount in frame. This is either added or subtracted to the running total of how much money has been put into or removed from the register respectively. Additionally, to support accessibility in our application, we have implemented large buttons and a text to speech feature that will read out each bill in the frame.

How we built it

we built this application by utilizing the computer vision algorithm "YOLO" (you only look once) allowing for us to view and detect the money that was in the frame of the camera. python scripts allowed for us take take the information that the camera saw and then integrate that into the Tkinter application to keep track of and adjust the incoming and outgoing transactions

Challenges we ran into

Going into this project, our team had very limited hackathon experience, so we were left with a ton of questions. How large should the project be? What are our skillsets? Despite this inexperience, we pulled through and completed a project that we are proud of.

Accomplishments that we're proud of

Our team is very proud to have been able to complete a full application from start to finish. Despite having little experience, we feel like the product we created was a result of our intense effort throughout the 24 hours.

What we learned

Our team greatly improved our skills in computer vision by using YOLO for the first time. However, the most significant growth from this project is the mindset we developed when thinking about what a consumer would want and then catering to that need.

What's next for Scaney Money

Our team would love to add more to the front end of this project, we see a room for improvement in improving the overall feel of the app, as well as layout and change in buttons