Project Logo

Auto Vision Scanner

Ever worried about losing your important documents? Or forgot about the place you had visited after looking at your memories? Worry not! We have a scanner that can solve all those problems of yours.

Idea/Mission

Built an Auto Vision Scanner using the powerful Google Cloud Vision API that scans the image, analyses and converts the image into text. It locates any textual content in the image and extracts it. You’ll be amazed by the extent to which the powerful Google Cloud Vision API visualizes and extracts the text from the image. It has no limitations whether it be a grocery/electricity bill, coursework, etc. It will help you save the paper and everything will be available as text. We were able to extract the similar documents all over the internet with their sources.

Project Inspiration

The main inspiration behind the project is the inconvenience we face on a day to day basis when there’s a need to store a doctor's prescription, medical bills, grocery bills, important notes, diary content and basically any important document that one has a possibility of losing when written on a paper. This project can easily solve this issue by digitally storing important documents.

On a broad level, this application can be used for investigation purposes for tracking and analyzing. In fact, the application has the capability to give similar image suggestions as well.

Tech Stack:

Google Cloud Vision API, Python, Flask, HTML, CSS, JavaScript, JSON, Android Studio, Java

Key Learnings

The application made us explore the Google Cloud Vision API for the first time, implement Flask while integrating it with HTML and Javascript.

Results

For Facial Emotion Recognition: It is giving the likelihood of all the emotions like joy, sadness, surprise, the positions of the features on the face. We achieved the confidence index close to 1 on many of the datasets.
For Text type image: It will give a detailed analysis of the image for example about the receipt of the grocery store. It will give the amount spent on each item and also the type of products which you purchased.

Future Scope

Currently, we have developed a web application, however, in the future, we plan to deploy it as a real-time mobile(webcam) application with more customer interaction including a chatbot with their identity.

Hackers

Ruchi Singh, Shivam Gupta, Harshita Rastogi

Built With

Submitted to

TAMUhack 2020

Created by

I worked on the development of the front end UI for the application, explored the Google Cloud Vision API's using HTML, Flask, CSS and JavaScript. Developed an Android App using Java and Android Studio.

Harshita Rastogi
I worked and explored on Google Cloud Vision API for the Image Analysis in various domain like likelihood of the emotion recognition of the face, positions of the features. The text analysis in the image which will tell about the details of the text, similar documents ( and their sources as well).

Shivam Gupta
I worked on the backend side of the project, explored the Google Cloud Vision API and integrated it with python and flask. Resolved issues in integration and deployment using heroku and android studio.

Ruchi Singh