Comic strip generator

Inspiration As a kid i always wanted to see my own imagination be a comic so its kind of like a dream come true

What it does This is a site where people can write a prompt for a story, which is then expanded by openAI model and then generated with panels and text to speech narration.

How we built it We built this using Python Flask for the backend, integrating OpenAI's GPT-4 model for story expansion and DALL-E for generating comic panel images. We also used Azure Cognitive Services for text-to-speech to narrate the story. For the front-end, its basic HTML/CSS with some JS for events.

Challenges we ran into We faced challenges in generating consistent comic panels in a uniform art style, as well as managing the timing and synchronization of text-to-speech audio with the comic panels. With limited resources such as subscription and the api uses from the free version, we cant create a fully consistent comic strip.

Accomplishments that we're proud of As it is our first time working with LLMs on code, it was fun to integrate models such as GPT and DALL-E into our website. While the functionality is minimum, it was a very fun task to complete.

What we learned The main thing we learned was topics such as hallucination and capabilities of LLMs. During our testing, we noticed that sometimes, very detailed prompts were actually counterproductive for generating the comic strips. And when we attempted to generate dialogues into the comic strip, we often noticed the model hallucinating which was new for us.

What's next for Wonder Strip With proper access to LLM subscriptions, we would be able to generate consistent comic strips. Additionally, we want to provide a better voice for the text-to-speech, as our current one is a very monotone narration. Some sites allow for a more soothing and human-like tone which however, was restricted due to costs.

Built With

• css3
• flask
• html5
• javascript
• llm
• open