We thought about how children tend to have many questions when it comes to things they see and touch in the environment around them. Combined with today's accessibility to smart devices for the younger audience, this gave us an idea about an application that may aid the child's craving to learn.

What it does

  • Our app is able to take an image of the object and identify the object using Google Cloud Vision.
  • This simple tool would provide the user of the name, a short description, and a detailed view of the item.
  • These screenshots may even be saved in one's own gallery where the user may refer to their past discoveries.

How we built it

We built the mobile application with the use of Java in Android Studio and connected it to Google's Cloud Vision API. Used Figma to design UI/UX and then imported it into Android Studio.

Challenges we ran into

Learning Android's new CameraX Library, learning how to use Google Cloud Vision API for mobile Combining Figma's front-end components to to back-end Android Studio code.

Accomplishments that we're proud of

After hours of programming and design, we are proud that we were able to create a very detailed proof of concept with fully functional prototype that shows a proof of concept that could be potentially used for educational purposes by all ages, especially kids.

What we learned

How to use Google's Cloud Vision, and its API in a mobile application.

What's next for KnowCap

We hope to add more features to our prototype such as an improved UI and updating our database with larger entries of items for image recognition.

Built With

Share this project: