Storyboard

prompt dialogue

Inspiration

We noticed a gap in the AI content creation space: while there are powerful tools like Luma Labs and ElevenLabs, using them together and iterating on a story idea was time-consuming and lacked a unified workspace. We wanted to make it simple to build a story concept—including video, audio, and dialogue—and quickly output an AI-generated video storyboard as a proof of concept.

What It Does

StoryBoard is a web-based editor that lets you create scenes, add background audio, and layer in dialogue. With built-in AI-powered prompts, it generates cohesive audio, video, and conversation elements, all seamlessly combined into a single storyboard video. A timeline editor provides an overview of your project, allowing for easy previewing, re-arranging, and editing of each storyboard component.

How We Built It

Our frontend is built in React, connected to a Flask backend that integrates with Luma Labs, ElevenLabs, and OpenAI APIs to generate video and audio elements. We developed a custom API endpoint to stitch all components together into one cohesive video output.

Challenges We Faced

Building a frontend video editor in one day was a major undertaking
Synchronizing and joining audio and video clips posed unexpected challenges
AI video generation occasionally produced less-than-ideal results
Creating prompts that generated high-quality outputs required fine-tuning

Accomplishments We're Proud Of

We built a user-friendly video timeline editor with intuitive functionality
Despite quick development, our product delivers reliable core functionality
Exporting a single, cohesive video brings story ideas to life in a satisfying way