Netflix X-ray

• 

  It identifies the character currently on the screen.

• 

  It can identify multiple characters.

• 

  It's especially handy when you don't remember the supporting cast's name

• 

  Click on the character to learn more about it through Microsoft Bing

• 

  Frank killed her at the first episode of Season 2

Inspiration

When watching a good show(Game of Thrones, The Sopranos, etc), I often find myself wanting to know more about a particular character/actor. And sometimes, I forgot the name of the characters. Wouldn't it be great to have someone who know all about the show around us during our viewing?

What it does

It is a chrome plugin for netflix. Whenever you want to learn more about the characters currently on the screen, just open the plugin, and it will identify the current characters/cast for you. You can also view the entire list of cast and characters in the current episode. And if you want to learn even more about that character/cast, you can click on the identification result, and it will show you more juicy information about them through Bing.

How I built it

I built the facial recognition system with Microsoft's cognitive service API, on a training dataset of celebrities' faces acquired through Microsoft's Bing Image Search API.

Challenges I ran into

I had to work around the rate limitation on the API calling when populating and training the face dataset.

Accomplishments that I'm proud of

The thing works.

What I learned

I have learned how easy it is to use MSFT's cognitive service api for for several Machine Learning tasks.

What's next for Netflix XRay

I would like to explore ways for machining learning algorithm to learn more about a particular scene in a movie/show.

Built With

• javascript
• microsoft
• microsoft-cognitive-service