Inspiration The inspiration for "Knights Out" was to create a fun, comedic narrative that playfully subverts classic fantasy tropes. We wanted to explore the idea of an unlikely friendship between a traditional knight and a demon like creature, placing them in a high-stakes Dungeons & Dragons-style quest. The core idea was to use the power of generative AI to build a world and tell a story that felt both epic and lighthearted, blending grand adventure with witty, modern sounding dialogue.

What it does

"Knights Out" is a proof-of-concept for a short animated film. It tells a complete micro-story, from character interaction and quest planning to a climactic confrontation and a humorous conclusion. The project serves as a showcase of how multiple AI tools can be orchestrated to produce a narrative-driven piece of entertainment, complete with unique characters, voice acting, and a cinematic score.

How we built it

This film was created by integrating several AI-powered tools in a creative workflow:

  • Visuals: The various scenes, characters, and environments were generated using an image model based on GPT. We used detailed text prompts to create the distinct visual style for the knight, his companion, the forest, the dragon, and the final explosive climax.
  • Voice Acting: All character dialogue was generated using ElevenLabs. We selected different voices to match the personalities of the stoic knight, his laid-back companion, and the quest-giver.
  • Music and Sound: The background music and atmospheric sounds were likely created with a tool like Producer.ai, which helped establish the fantasy and comedic tones of the film.
  • Animation and Editing: To bring the still images to life, we used a video generation tool like Hailou (or a similar platform) to add motion, camera pans, and zooms. These animated clips were then compiled and edited together to form the final narrative sequence.

Challenges we ran into

One of the biggest challenges was maintaining visual consistency with the characters across multiple AI-generated scenes. For instance, the demon companion's appearance subtly changes throughout the video. Another hurdle was generating specific actions and poses that perfectly matched the script. We had to carefully craft our prompts and generate many variations to find images that fit the story. Finally, seamlessly integrating the different AI-generated elements—visuals, voices, and music—into a cohesive and well-paced film required careful editing. Accomplishments that we're proud of We are incredibly proud of creating a complete narrative short film almost exclusively with AI tools. We successfully established a distinct comedic tone and built a charming rapport between the two main characters. We feel the final sequence, from the dragon's appearance to the massive explosion, is a major accomplishment, showcasing the cinematic potential of this technology. Most importantly, we created a finished piece that tells a fun and engaging story. 🎬 What we learned This project was a fantastic learning experience in AI-driven filmmaking. We learned how to create a multi-tool workflow, using the strengths of each platform for different aspects of production (images, voice, animation). We gained significant experience in prompt engineering to control the artistic style and narrative details. The process taught us about the current capabilities and limitations of generative AI for storytelling and how to creatively work around them.

What's next for Knights out

This is just the beginning! We see "Knights Out" as a pilot for a potential series. The next steps would be:

  • Expand the Story: Develop a full-length episode that explores the world further and maybe even reveals what happened to their missing friend, "Pimp."
  • Develop the Characters: Dive deeper into the backstory of the knight and his demon companion.
  • Refine the Technology: Work on improving visual consistency and exploring more advanced AI animation techniques to create more dynamic action sequences.

Built With

  • chatgpt
  • elevenlabs
  • hailou
  • youcut
Share this project:

Updates