Music Video Submission 1

Inspiration

This project was inspired by my ongoing worldbuilding efforts in a cyberpunk/sci-fi universe called Scavenjer that is linked to a solo augmented reality game project I've been building for three years. I wanted to use my vision to merge creative storytelling and genre-blending music into a single immersive piece. The goal was to push the boundaries of what a music video could be given the current environment of AI tools.

What it does

The music video presents an AI-generated cinematic experience that combines storytelling, my creative vision for my project and AI music production. It portrays an emotional storyline of an individual in a future that could very well be reality one day where advanced technology is utilized to keep someone alive that likely would have died. The visual dynamic gives a brief view into what that type of narrative could look like.

How we built it

I created this video with a large number of AI tools being:

• Google's flow for moments where prompt coherence was absolutely needed.
• Higgsfield for when creativity for a video output was a priority.
• Midjourney for omni-referencing in order to keep our characters consistent (before nano-banana).
• Leonardo.ai for certain image upscaling and image generation for cinematic scenes.
• Elevenlabs for certain voiceovers needed to improve story elements.
• Topaz for upscaling low resolution video outputs from the AI models.

Challenges we ran into

Some challenges I ran into were cost (probably obvious), prompt coherence for getting the AI models to understand my vision when creating certain environmental scenes or looking to make color adjustments and keeping characters consistent across multiple scenes. The video was made before the release of google's nano banana so being able to generate consistent scenes was extremely difficult and time consuming.

Accomplishments that we're proud of

I'm proud that I was able to come up with a music video that not only contains good music to listen to, but that also gives the viewer a story that is still human, despite all of the AI tool usage that was involved. I've always had the creative vision that needed to be shown to the world. With AI tools, I've been given the opportunity to showcase one of the many stories I've been holding onto for years.

What we learned

I learned how to make better use of the AI tools available. I learned more about about the failings of my creative vision that helped me improve. This creative process was humbling because although AI tools have made it easier to express ourselves, it still cannot complete the creative vision. I learned how to improve my processes in order to achieve better results.

What's next for Music Video Submission 1

One more video will be submitted in hopes of being able to win this contest and push my project further along which I believe results in people within our society going outdoors more while being given the unique media experience created by AI that compliments their interactions with my project.

Built With

• elevenlabs
• google
• higgsfield
• leonardo.ai
• midjourney
• suno
• topaz