Streamlined Showtime

Inspiration

I used to write a lot of scripts, and still enjoy it. But, with no intention to get into script writing as a profession, there was nothing to do with the scripts. With AI generated video getting so good now, I realized I could create a well defined process that could automatically take a script and turn it into an actual film.

What it does

The process starts by processing your script. To have a good result, we need reference images for everything and we need the script divvied up into clips that make sense. Since clip length options vary between the different video generation services, we simply round up to the closest length. The process creates reference image options for a scene/room and a character. With that, we can either provide feedback and iterate on it further, or we accept a style for each and proceed. The process then creates every needed reference image. This makes it so that we have consistency within the video generations.

Then we move onto creating the actual video clips. There are numerous options for AI Video generation so the app is setup to be able to utilize a good number of those options. For my particular setup, I have the Adobe suite anyway so I have Firefly credits and so those are what I'd prefer to use so I integrated a flow to use this via the website as well. However, for the most part, it focuses on AI generated video options that have api's.

From there, it's time for quality control and any last additions we need. We review and adjust clips as needed, also automatically with AI. Then, we add any other background music and voices as needed.

How we built it

Streamlined Showtime is built with a Python/FastAPI backend and a custom JavaScript/CSS interface. It uses Ollama for script analysis, shot planning, and quality checks. It uses Playwright and provider APIs for image, video, voice, and music generation. For media inspection and final assembly it uses FFmpeg. Genblaze with Backblaze B2 are used to safely store every file, track how each asset was created, and continue from where production left off after a pause or crash.

What's next for Streamlined Showtime

As more generative AI tools get made and improve, this app can get stronger and better. As is, the big name in AI music is Suno, but they don't have an API yet, so things like that can be more directly integrated as the app builds out further. Pretty obviously, if AI ever gets better at script writing, it could do fully autonomous show creation as well. In general though for where it stands, it's already pretty cool and a good start, so hopefully you enjoyed this project. Have a good one.

Built With

• adobe-firefly
• backblaze-b2
• css
• fal.ai
• fastapi
• ffmpeg
• genblaze
• google-gemini
• html
• javascript
• ollama
• openai-api
• playwright
• python
• suno