AI Assisted Auto Dubbing (soft submition)

Introduction
Sample: English to Hindi
Sample: English to French
Sample: English to Japnese
Demo

Inspiration

I has this idea while I was watching "Takt Op. Destiny" anime and my brother kept complaining about how difficult it is to focus on anime and read subtitles, this was when I started thinking about this idea.

What it does

This website allows users to upload any video, and through the use of Google Cloud machine learning services, received a dubbed copy of that video in a language of their choice.

How we built it

The app was built with a Django back-end and VueJS front-end. This was integrated with Google Firebase for data storage and authentication, alongside Google Cloud's text and audio-based machine learning services to provide an accurately dubbed version of the video.

Challenges we ran into

Figuring out how to integrate all the Google Cloud services was a challenge for us, as we are both still quite new to machine learning and firebase services. We also ran into issues trying to figure out how to correctly parse the audio from the video files, and use that audio with Google Cloud's machine learning.