The Ark

Inspiration

Just my imagination, I think. First, I made a song. Then, I wanted to make a video for it.

What it does

It tells a story about the Ark - last bastion of humanity in a world where the light is gone, and monsters are lurking in the darkness. The last survivors managed to build the giant moving base, and its light protects them from the spawns of darkness, but they must go on dangerous missions to gather supplies and try to keep their sanity in a nightmarish world.

How we built it

With the help of some cutting-edge AI's that are listed in the description. I created a story in my mind, then turned it into a song. Then I generated images that could help me tell that story, and tried to animate them, and then assembled the vieo from those, which animation quality was acceptable. Not going to lie - in many ways it did not work they way I wanted it due to limitations in current-get AI. But I still tried to make it as atmospheric and beautiful as I possibly could.

Challenges we ran into

Combat animation. Somehow, all the available video generators are not really trained for that kind of scenes, that seems weird to me - because combat is the part of most existing stories. Making my characters fight monsters were a real challenge - many times I got refusals due to censorship, and the attempts that went through were looking nothing like combat. Simillar problem was with picturing monsters. Also, for some reason asking for darkness with only specific light sources is too much for the AI, who always try to add unwanted light source into the picture, so I had a lot of troubles fixing that.

I actually wanted the Ark to be taller than most buildings, but for some reason generators I worked with simply refused to do so. They ignored any kind of size change commands, especially in the forest areas, where they were drawing Ark smaller than trees. So I had to cut those areas entirely.

Accomplishments that we're proud of

How I still managed to portray the mood of the hopeless world covered in darkness, where humans can do nothing else but surviving against the odds and nightmarish creatures.

What we learned

Advanced prompt engineering.

What's next for The Ark

Would be nice if people will see and enjoy it.

Built With

• dreamina
• google
• luma
• saga
• suno