Open Heart Surgery

• 

  Thumbnail for Open Heart Surgery

Inspiration

I wanted to make an AI idol but singing in a non-KPop genre such as jazz/RnB.

How I made it

This music video was made by one person over the course of approximately one week using mostly OpenArt, VEO3.1, Kling 2.1/2/5, Seedance 1.0, Seedream 4.0, and NanoBanana.

Challenges we ran into

Character consistency is always the biggest challenge for me. I tried to keep the shots to close-up shots and extreme close-up shots in order to retain the most consistency of the singer's facial likeness. Anything beyond a medium shot would produce character drift when fed into VEO 3.1, which tends to morph the face of your character. I found that Kling 2.1 and 2.5 did better with maintaining consistency and not morphing the face, although Kling's lip sync is lacking compared to VEO 3.1, which is why I use VEO 3.1 for all of my lip movements.

Accomplishments that we're proud of

I am happy with the lip sync results, which is something that I focus on.

What's next for Open Heart Surgery

Full album?

Built With

• ai