Inspiration
Im an ai builder and speaker. Built a big ai community and create technical content and provide training for devs. As a part of my conferences, I create promo teaser video. This time I took it to the edge with mind blowing tools combinations.
What it does
Pixar style 2:10 minutes video that tells the story of my conference theme, AI beyond the hype.
How we built it
- trained a Lora on my photos with flux dev
- generated images of me in Pixar style
- created a dataset of my Pixar character
- trained another Lora with Ai toolkit locally in my Pixar style, Nvidia 4090rtx local training
- generated images using the Lora with flux KREA dev as base model via ComfyUI
- created pairs of first last frames
- used flux Kontext to train Lora of the Pixar style I liked
- used flux Kontext to generate consistent character
- used ComfyUI + Hailuo minimax to turn the frames into videos
- used Elevenlabs to generate voice
- used suno to generate music background in the second half of the video
- edited with CapCut locally
Challenges we ran into
- training dataset captions made the training break if it wasn’t good enough
- very hard to maintain character consistently
- flux Kontext sometimes makes the faces break
Accomplishments that we're proud of
- I got mind blowing result, state of the art, feedbacks even from creators and studios were amazed!
What we learned
- ai toolkit with Nvidia local training and flux ComfyUI for generating images can help us create anything!!!!
What's next for Promo teaser in Pixar style
- follow up episodes, you must watch!!
Log in or sign up for Devpost to join the conversation.