Duende

Inspiration

The project was born from a single, powerful word: "Duende." Coined by poet Federico García Lorca, it describes the soul of flamenco—a mysterious, raw power that rises from the earth, a struggle, not a thought. I wanted to create a visual narrative that captured this feeling, telling the story of a musician whose art is not just a performance but a deep, internal journey. The inspiration was to fuse the passionate, world-weary soul of flamenco with the timeless, mystical imagery of ancient Egypt, creating a dreamscape where music becomes a vessel for an imaginary love story and a voyage into the artist's own spirit.

What it does

"Duende" is a short, experimental music film that visualizes the transformative power of artistic creation. It takes the viewer from a stark, monochrome reality into the vibrant, psychedelic inner world of a lone guitarist. As he plays, his music conjures an entire universe—a love, a muse, and a journey through a fantastical, neon-lit Egypt. The film functions as a non-verbal narrative, using color, motion, and symbolism to tell a story of passion, imagination, and resilience, culminating in a surprising and emotional reveal that re-contextualizes the entire journey.

How I built it

This film is a product of a cutting-edge AI-driven workflow, which I orchestrated entirely within ComfyUI.

• Visual Generation: The core visual engine was the powerful new FLUX model (using both uso and dev versions for experimentation) to generate the highly detailed and stylized frames. This allowed me to achieve the unique blend of psychedelic art and ancient Egyptian motifs.
• Animation: I brought the still images to life using the wan2.2 animation framework. This enabled the fluid transformations and dynamic motion, creating a seamless flow from one scene to the next.
• Audio-Reactivity: To deepen the connection between the visuals and the music, I integrated subtle audio-reactive elements. Certain parameters in the animation and visual effects were linked to the flamenco track's transients and frequencies, causing the world to subtly pulse and react in sync with the guitar's rhythm and intensity.
• Storytelling: The entire process was guided by a clear narrative arc, with each scene and transition carefully prompted and curated to build the story of the musician and his imagined muse.

Challenges I ran into

The primary challenge was maintaining narrative and character consistency within the chaotic beauty of AI generation. Ensuring the guitarist and his muse retained their core features across vastly different scenes and styles required meticulous prompt engineering and countless iterations. Another significant hurdle was mastering the complex ComfyUI workflow; getting the FLUX models and wan2.2 animation nodes to work together harmoniously was a technical deep-dive. Finally, pacing the visual intensity to match the song's emotional crescendo—making the audio-reactivity feel artistic rather than robotic—was a delicate balancing act.

Accomplishments that I'm proud of

I am incredibly proud of the film's emotional impact. Successfully crafting a story that leads to a meaningful and surprising final twist is my biggest accomplishment. This twist elevates the piece from a simple visualizer to a poignant commentary on the power of the human spirit. Artistically, I am proud of the unique aesthetic fusion I achieved. On a technical level, I successfully integrated multiple state-of-the-art tools within a complex workflow to create a cohesive and visually stunning piece that pushes the boundaries of AI-driven filmmaking.

What I learned

This project reinforced a core lesson: technology is a paintbrush, not the painter. Even with the most advanced AI tools, a powerful story and a clear artistic vision are paramount. I learned the immense value of patience and iteration, understanding that the best results often come from refining workflows and embracing the "happy accidents" of the generation process. Most importantly, I learned how to translate a deeply abstract and emotional concept like "duende" into a tangible, visual narrative that connects with an audience.

What's next for Duende

"Duende" feels like the beginning of a larger exploration. The immediate next step is to refine the technical workflow I developed, possibly creating custom nodes to streamline the process for future projects. I am also exploring the idea of "Duende" as the first installment in a series of short films. Each film would be dedicated to visualizing other untranslatable, powerful words from different cultures, using AI to explore the universal emotions that connect us all.

Built With

• comfyui
• flux
• modal
• runpod
• thinkdiffusion
• wan2.2