Inspiration

deepart.io is cool but takes a while to get sent an image back and I thought it would be neat to hook directly into social networks and create a bot that stylizes images.

What it does

Send a picture to the bot on twitter with #Stylize @StylizeBot and it will reply with that photo painted like a famous painting.

How I built it

I used a keras model I found on github which is trained on imagenet using vgg16. A node js microservice searches twitter for mentions @StylizeBot with #Stylize and then using the keras model does a neural style transfer based off a famous painting then reuploads that image as a reply to the original tweet.

Challenges I ran into

Hosting the keras model. AWS kept running out of memory finally I got it working when hosted on azure.

Accomplishments that I'm proud of

Figuring out the memory issues to get it to work on a hosted server.

What I learned

A little more about the inside workings of keras theano and tensorflow. As well as using the twitter api.

What's next for StylizeBot

Tagging photos with say #monet and it sends back a stylized photo like monet instead of just using a random famous painting as the style image.

Built With

Share this project:

Updates