Inspiration
This project was inspired by my ongoing worldbuilding efforts in a cyberpunk/sci-fi universe called Scavenjer that is linked to a solo augmented reality game project I've been building for three years. I wanted to use my vision to merge creative storytelling and genre-blending music into a single immersive piece. The goal was to push the boundaries of what a music video could be given the current environment of AI tools.
What it does
This specific soundtrack and music video are the introduction into this artist's official music album. This video presents an AI-generated cinematic experience that combines storytelling, my creative vision for my project and AI music production. It portrays a chaotic music artist presented in a modern visual display. The tone and dynamic of this music artist sets the stage for a story being told in a full-length concept album.
How we built it
I created this video with a large number of AI tools being:
- Google's flow for moments where prompt coherence was absolutely needed.
- Higgsfield for when creativity for a video output was a priority.
- Google's Nano-banana for getting the specific scenes that matched the visuals in my head.
- Leonardo.ai for certain image upscaling and image generation for cinematic scenes.
Challenges we ran into
Some challenges I ran into were cost (probably obvious), prompt coherence for getting the AI models to understand my vision when creating certain environmental scenes or looking to make color adjustments and keeping characters consistent across multiple scenes.
Accomplishments that we're proud of
I'm proud that I was able to come up with a music video that not only contains good music to listen to, but that also gives the viewer a creative dynamic created by a human, despite all of the AI tool usage that was involved. I've always had the creative vision that needed to be shown to the world. With AI tools, I've been given the opportunity to showcase one of the many stories I've been holding onto for years.
What we learned
I learned how to make better use of the AI tools available. I learned more about about the failings of my creative vision that helped me improve. This creative process was humbling because although AI tools have made it easier to express ourselves, it still cannot complete the creative vision. I learned how to improve my processes in order to achieve better results.
Log in or sign up for Devpost to join the conversation.