Cre8PlotPro

Inspiration

Social Media has taken the world by storm and Singapore is no stranger to this phenomenon, holding the 10th spot in global social media adoption.

A noteworthy trend on platforms like TikTok involves artists sharing their life stories through captivating comic strips, employing individual panels accompanied by text captions. This creative fusion of visual storytelling and personal expression has become a compelling and widely embraced form of content.

But some might ask “I have a story to tell, but I can’t draw well. What do I do?”

Don’t worry, we got you!

What it does

It’s components consist of a telegram Chatbot, a model to do image generation and a model to do text paraphrasing.

How we built it

We chose to build a telegram bot to make it more accessible to those that aren’t as tech-savvy and then integrated with FastAPI to call the 2 necessary models to generate the necessary output.

Next, A generative AI model called Stable Diffusion is called with the Stability API to generate the scene and characters of a panel.

Finally, a specialised language model variation of PEGASUS is used, one that is tuned for paraphrasing.

Challenges we ran into

• Finding suitable models
• Integration with Telegram Bot and FastAPI

Accomplishments that we're proud of

• Creating something unique and convenient for people to use

What we learned

• How to work as a team
• New technologies (first time building an AI application and telegram bot)

What's next for Cre8PlotPro

• Given just 1 prompt instead of multiple, generate the whole sequence of panels

Built With

• fastapi
• pegasus-paraphrase
• python
• stabilityapi
• telegrambotapi