“The Dream” is a 7-1/2 minute long animated AI adventure by Jeff T. Alu. It is about a boy who falls asleep and dreams about many things, but then wakes up in an unexpected place. The entire adventure was created in five weeks.

All of the imagery, video sequences, and music are AI generated. Using AI to create video sequences can be challenging, especially when your main characters need to look the same from scene to scene. Luckily, image generators such as MidJourney can help with this. They have the ability to take images of a character and apply that same character to different situations. Those new output images can then be used as starter images for video sequences. All of these images and videos were created without the use of sophisticated 3D software. They were created using something very familiar to all of us: words.

MidJourney was used to create all of the starter images in our journey. Those images were then taken over to Lumalabs Dream Machine and turned into five second long videos. The music was created using Udio. In all of these cases, much experimentation was needed to get the desired results, and sometimes the results were very unpredictable. If you watch the closing credits of this film, you will see examples of videos that did not turn out as planned, some requiring many takes!

Built With

  • davinciresolve
  • lumadreammachine
  • midjourney
  • udio
Share this project:

Updates

Submission history