Inspiration

AI has been a tool to try and solve many of the world's problems. From medical diagnoses to making the roads safer with self-driving cars. Today, we try and tackle one of the biggest challenges in the modern era, making quality memes or image macros.

What it does

Generates text for a given image macro. Uses machine learning to determine the good text for memes.

Example

meme

Click here to see the album

How we built it

  1. Use webscraping to build a large set of memes.
  2. Group them by template using the image similarity.
  3. Use OCR to read the text.
  4. For each template, train a neural network to generate new text.
  5. Utilize google cloud virtual machine for faster computation with a lot of input memes. ??? profit

Challenges we ran into

  1. Being able to read the font. OCR does not like reading memes.
  2. Tuning the neural network to output text.
  3. Google Cloud GPU and CPU restrictions
  4. Disk quotas preventing us from running the code in Linux
  5. Python dependency issues for importing TensorFlow and similar libraries

Accomplishments that we're proud of

Using selenium to scrap lots of memes from the internet, Sorting memes by image format, Using google cloud to run and train the AI, Using tesseract and how to train and use OCR,

What we learned

  • How to use OCR,

  • How train a AI using text,

    What's next for Deep Meme

  • Making OCR more accurate

  • Creating more formats

  • Social media bot Increase funniness

Share this project:
×

Updates