A quick note: Our repo contains the entirety of the code for our 2022 HopHacks project. We got the backend of our project working but we couldn't quite get the finishing touches together by the deadline. We are nonetheless proud of what we achieved. We implemented an AI system to derive the critical information off a receipt. We designed a bank statement parser to read in a PDF and return data that can be compared to receipts. We build a backend firebase integrated database management system that control the upload of new photos and bank statements and compares the two for fraud. We made a really awesome looking front end user management system that was connected to our firebase backend system. The overall integration of these 4 aspects was not quite ready by the end of Hop Hacks but the four of us plan to continue working on it in the coming weeks. We all believe in the project and personally want to see it through, both for the personal benefit of having such an app to use in our daily lives, and out of a commitment to the work that we started.
Thank you to the HopHacks team for facilitating this great experience.
Inspiration
We personally know that we should be keeping track of the countless receipts we get every day but never can. This project was birthed out of a tangible need to get our stuff together and get organized.
What it does
Our app allows a user to scan a a receipt and upload their bank statements to automate the process of storing pertinent receipt data and also check for fraud. We automated the scanning with the use of PyTesseract and Open-CV and a custom build NLP system to find the relevant features. The fraud detection system cross references the users securely stored bank statements with their collection of uploaded receipts to find unaccounted for payments. This is all managed by a Firebase backend system that processes and stores all the information uploaded to the cloud from our IOS app.
How we built it
We built most of the backend either with Firebase's development tools, in XCode/Swift, and in Python.
Challenges we ran into
We were not able to ever unify the four aspects of our project due to some issues with the front end IOS app. (None of us had any prior experience with that but are all excitedly learning). Nonetheless we are already planning on meeting next weekend to finish our project up.
Accomplishments that we're proud of
We are incredibly proud of the goals we set. Now we know our project may have been a shade too ambitious, but it is through that ambition that we were able to learn so much about both the quirks of Firebase and XCode. We all agree that if we could do it all over we wouldn't have changed our plan at all. We came here to create, develop and learn, and that is exactly what we did, in abundance.
What we learned
We learned a million things about the way XCode/Swift works as well as a ton about the Fedora linux system that we were running through firebase.
What's next for Receipts&More
Next weekend we are going to sit right back down where we are right now and continue working. We love the project and see no reason for it to stop just because HopHacks is over.
Log in or sign up for Devpost to join the conversation.