Inspiration
deepart.io is cool but takes a while to get sent an image back and I thought it would be neat to hook directly into social networks and create a bot that stylizes images.
What it does
Send a picture to the bot on twitter with #Stylize @StylizeBot and it will reply with that photo painted like a famous painting.
How I built it
I used a keras model I found on github which is trained on imagenet using vgg16. A node js microservice searches twitter for mentions @StylizeBot with #Stylize and then using the keras model does a neural style transfer based off a famous painting then reuploads that image as a reply to the original tweet.
Challenges I ran into
Hosting the keras model. AWS kept running out of memory finally I got it working when hosted on azure.
Accomplishments that I'm proud of
Figuring out the memory issues to get it to work on a hosted server.
What I learned
A little more about the inside workings of keras theano and tensorflow. As well as using the twitter api.
What's next for StylizeBot
Tagging photos with say #monet and it sends back a stylized photo like monet instead of just using a random famous painting as the style image.
Log in or sign up for Devpost to join the conversation.