Marketing Meme Generator

Tired of paying interns to market your product? Do it yourself! This project parses an example dataset using an OCR model and uses the Cohere LLM to generate an image macro in the same format.

Comment

What it does

An image macro is a form of internet meme where text is added onto specific images. While they are often used for humour, they can also be used for other purposes such as marketing.

This project allows the user to generate their own macros which promote a product. First, the user gives several example macros which originate from a template image. Then, the user inputs the product name and "top text" of the macro they want to generate. By using the examples together with the input data, an LLM can produce a new macro in a format similar to the examples that promotes the product.

How we built it

There are two parts to this project:

  • Extracting the text from examples: By performing several manipulations on the example image using the template image, the text can be isolated enough for it to parsed by an OCR with great accuracy.
  • Generating the new macro with an LLM: Through reading articles and trial and error, several insights into generating pattern-based output were found:
    • At the beginning of the prompt, state the purpose (ex. Generate a viral image macro...)
    • Use adjectives to make small adjustments to the output and define any words which may cause confusion to the LLM (ex. ...a viral image macro advertising the product "[PRODUCT NAME]")
    • Make sure the examples are clearly defined (ex. 
...in a similar format to the examples.

Top Text: [EXAMPLE TEXT]...

)

  • At the end, insert an incomplete example for the LLM to fill in (ex.
...[EXAMPLES]

Top Text: [USER INPUT]
Bottom Text:

)

  • Ellipses can be used to encourage the LLM to complete a phrase from a previous line (ex.
...
Top Text: HAVE A [PRODUCT NAME]...
Bottom Text: "

)

Challenges we ran into

In the end, most of the time was spent writing the image processing and LLM code, leaving little to no time to write a front-end. Over the course of 3 long hours, a barely-functioning front-end was cobbled together.

What's next for Marketing Meme Generator

Maybe in the future, all internet content will be generated through processes like this :D

Built With

Share this project:

Updates