Inspiration

This scene was highly inspired by the parade sequence from the Film Paprika. The material is independently written on a Discord roleplay server that I am a member of.

What it does

This was my first foray into building an actual scene using A.I. Experimenting with diagetic storytelling with limited dialogue. And delving into some surrealism.

How we built it

  • Storyboarding: a rough outline
  • Character creation: built some decent refferences to use in scenes.
  • Shot/framing and composition: basically arguing with AI to compose a starting frame/still a shot (not fun and probably not efficient lol) hardest part is maintaining scene continuity, keeping spatial logic and lighting consistent.
  • Prompt development: spending too much time finessing camera movements, subject actions and lighting.
  • Generating - 70% good generations alot are just unuseable
  • Editing and dubbing (lip syncing). Alot of material isn't used haha.
  • Music and sound favourite part. Brings the project to life.
  • And then any text elements.

Challenges we ran into

A.I spatial logic and continuity. As explained above creating multiple shots within the same scene that maintains lighting continuity and a sense of the space the subject is in was probably the toughest part. For example: the shots where he is in his room. Making sure the lamp remains in the shot based on the camera shot/angle. Was difficult creating the starting frames because it would misinterpret the space.

Accomplishments that we're proud of

Im super happy with the output here. It feels like a real film sequence. (Well I hope it does)

What we learned

That despite the quality of ai video creation... I find that creating nuanced expressions and emotions is still a little tough to nail. Models will over exaggerated certain expressions. Doing some RCA, I had to learn to word things more cleverly for the shots.

What's next for Solace Noir - Franco's Revery

Probably another scene. Perhaps him at a crime scene doing an examination. Or some exposition into his dark secret that haunts him.

Built With

  • capcut
  • chatgp
  • elevenlab
  • kling
  • openartai
Share this project:

Updates