Inspiration

While studying at 6 a.m., I just had this song playing in my head. But I don't play a single musical instrument. Enter AI. And this is the result.

What it does

"Dayanmadan" is a complete musical composition and video that demonstrates a new workflow for human-AI collaboration. At its core, the project uses Riffusion to create the foundational melodies and soundscapes of the song. I act as a curator, producer, and poet, weaving these AI-generated ideas into a cohesive, emotional track. It's not just an "AI song", it is a song that lived in my imagination, but could have never been expressed without AI.

How we built it

Ideation: Started with the human-centric theme of "Dayanmadan" and wrote the core lyrics.

AI Generation: Used Riffusion to generate a wide array of musical "riffs" and textures based on prompts related to the song's mood (e.g., "melancholy piano," "driving hip-hop rain," "Azerbaijani rap").

Curation & Production: This was the most critical step. I sifted through dozens of AI outputs and selected the most compelling pieces.

Integration: The AI-generated loops were arranged, layered, and produced.

Video animation: Insipired by the LoFi Girl, Sora enabled us to produce the Azerbaijani version.

Challenges we ran into

Our biggest challenge was curation. The AI generated hundreds of ideas, and finding the "signal in the noise" - the specific loops that fit our lyrical and emotional theme - was a massive task. I spent a lot of time in production to make the AI elements feel "alive" and seamlessly blend with the lyrics.

Accomplishments that we're proud of

We are incredibly proud of the final track's cohesion. A few people have praised my "singing skills" - although it is entirely AI singing. And Azerbaijani is not a prime language that AI is trained on - I am stocked I was able to get AI to pronounce the local accent of my hometown so authentically.

What we learned

Without the human direction, curation and creativity, AI is just a tool. But it is a tool that can be used to make things that would otherwise be impossible.

What's next for Dayanmadan

Inspire other non-musicians, non-animators, non-movie-directors and others to bring their ideas to life using AI. And create new projects myself, of course.

Built With

  • chatgpt
  • sora
  • udio
Share this project:

Updates

Submission history