Found the Gold - Marco's Pizza

• GIF

  Actor Input video driving a character

• 

  Happy Pirates

• 

  Ship at Sea

Inspiration

We wanted to make a commercial with pirates! Pirates are awesome. Seeing adventurous characters sailing on the high seas has always been a dream for our videos so when it came time to make this commercial it was a natural choice for our team!

What it does

This quick 15 second commercial features custom TTS, lip sync with characters designed by our team. Additionally, it features a call to action near the end to entice the customer to purchase the pizza!

How we built it

Using a combination of some of the greatest tech in the world (11labs, Runway, Google's Nano Banana, FAL, Kling, HailuoAi, etc) we were able to create frames, turn those frames into videos using I2V (image 2 video), and then use 11labs to bring it to life with audio including sound effects & music!

Challenges we ran into

The most challenging portion of this video was getting the lip sync to look accurate and match the character's head movements. Particularly where the character was speaking and they would throw their head back in amusement... getting the lip sync to accurately track to the characters position was more difficult than originally anticipated. By thinking creatively and out of the box we're able to get it working!

Accomplishments that we're proud of

The use of Runway's Act-One really shines here on the lip sync for the pirates and their excited facial expressions! We showed this commercial to Marco's Pizza and got approval to run a pilot on television at some of their stores!

What we learned

We loved learning about the 11labs "Voice Changer" mode! Our team was able to record voice lines and then change the voice to match the pirate by using the 11 labs voice changer feature. This video also was the perfect opportunity for our team to learn how to use Runway's Act-One feature to get the lip sync perfect we actually had members of our team act out the lip sync on camera and then we animated some portions of the lip sync using the Runway Act-One tool... it took a few different takes!

What's next for Found the Gold - Marco's Pizza

This commercial is live in the Michigan, USA region and has been shown to over 2 million real customers! We are continuing to run this ad with Marco's Pizza and test this commercial with real customers!

Built With

• 11labs
• adobe
• kling
• nano-banana
• runway
• veo
• wan