Inspiration
We often find ourselves watching videos on the web wondering where we may have seen a person before or what music is playing in the background or even resources to learn more about the subject being discussed. An AI should be able to identify this stuff.
What it does
Our browser extension will answer those above questions!
How we built it
We used an open source tool face-api.js which is built on TensorFlow.js, packaged it into a Google Chrome extension to run perfectly on YouTube videos.
Challenges we ran into
Mostly display challenges and gathering enough images to identify people accurately.
Accomplishments that we're proud of
Leveraging Chrome extension's background scripts to offload the matching logic to.
What we learned
There's still a long way for us to go before we can incorporate music identification and topic of discussion.
What's next for Web Helper AI
Get some publicity from Google's PR outreach and grow a user base, identify if the product has a market. Build additional models in TensorFlow to process various content such as text, brands, and buildings. We would also like to display more relevant information on the identified objects.
Built With
- face-api.js
- javascript
- tensorflow
Log in or sign up for Devpost to join the conversation.