Multiverse

• 

  Lip syncing training and voice translation in real-time

Inspiration

Growing up as an international family, seamless communication would of been transformative for our entire families.

What it does

Voice to voice translation keeping same emotion, voice cloning, lip syncing across languages,

How we built it

SeamlessExpressive (Meta) GeneFacePlusPlus

Challenges we ran into

• Complex multi-stage ML pipeline in real-time and fine tuning in under 24 hours

Accomplishments that we're proud of

• First real-time voice dubbing and syncing model

What we learned

• It's hard

What's next for Multiverse

• IPO

Built With

• genai
• python
• spirit