🎄 I Want You Under My Tree

💡 Inspiration

I wanted to explore how far AI tools have come in helping independent creators produce complete multimedia projects — not just a song, not just a video, but an emotionally cohesive music experience. "I Want You Under My Tree" started as a fun experiment to see if I could go from an idea in my head to a fully produced music video, powered almost entirely by AI tools.

🎵 What it does

"I Want You Under My Tree" is an AI-generated pop song and music video created using a combination of generative tools. From the lyrics and melody to the visuals and final editing, every step leverages AI assistance — resulting in a festive, surreal, and surprisingly human piece of art.

🛠️ How we built it

The production pipeline combined several AI and open-source tools:

Writing the song (ChatGPT) I used ChatGPT to brainstorm lyrics, structure verses, and refine the theme — a mix of holiday nostalgia and romantic longing.

Composing and generating audio (Suno v5) Using Suno.com v5, I generated multiple musical versions of the song and selected the best one. I then exported the stems (vocals, instruments, and backing) to work with in post-production.

Splitting the track (FFmpeg) FFmpeg helped me split the audio into segments — intro, verses, chorus — to sync each section with specific visuals.

Generating visuals (ComfyUI + Humo) I used ComfyUI with the Humo node setup to produce video sequences driven by both image prompts and the song's audio. This created dynamic, rhythm-synced motion that gave the visuals life.

Editing and syncing (Kdenlive) Finally, I combined the generated clips and audio stems in Kdenlive for fine-tuning, color correction, transitions, and final rendering.

⚔️ Challenges we ran into

  • Audio-visual synchronization: Getting the visuals to match the beat required experimenting with FFmpeg timings and Humo parameters.

  • Rendering times: AI video generation is computationally heavy, so optimizing frame generation speed was a must.

  • Consistency: Maintaining a consistent artistic style across different AI-generated segments took several iterations.

🏆 Accomplishments that we're proud of

  • Creating a cohesive, emotional music video entirely through AI tools.

  • Building a repeatable creative pipeline that blends text, audio, and visuals seamlessly.

  • Learning to integrate tools like Suno, ComfyUI, and FFmpeg into a single artistic workflow.

📚 What we learned

  • AI can be a genuine creative collaborator, not just a utility.

  • Different tools excel at different stages — it's all about finding the right rhythm between automation and direction.

  • Open-source editing tools like Kdenlive are perfect for bringing everything together in the final stage.

🚀 What's next for I Want You Under My Tree

I plan to:

  • Experiment with AI motion generation synced directly to lyrics.

  • Release a "making-of" video showing the step-by-step process.

  • Explore interactive music video experiences where viewers can influence visuals or sound in real time.

Built With

  • comfyui
Share this project:

Updates

Submission history