Inspiration

I saw this paper where they made south park episodes from prompt. I wanted to build something similar. So I built a video generator, few months back. There was no users, so I recently started this gamified version using the old codes of it.

What it does

You enter a prompt for plot, it uses LLM to build a script, then image models to generate assets, and TTS to generate audio. It then stitches the things into a video and gives you are immersive RPG experience. At each point you can provide direction on how you want the story to move forward. It progresses accordingly.

How we built it

Using the help of GPT, some old code and a lot of effort.

Challenges we ran into

Defining the pipeline with a lot of non deterministic things is hard. You had to compensate for it in code.

Accomplishments that we're proud of

It works.

What's next for Stories By Angris

I just introduced editing feature and learning mode. I want to try this out with small kids to see if they benefit from learning a concept taught with cartoon story.

Built With

  • elevenlabs
  • fastapi
  • mixtral
  • mongodb
  • nextjs
  • stablediffusion
Share this project:

Updates