I has this idea while I was watching "Takt Op. Destiny" anime and my brother kept complaining about how difficult it is to focus on anime and read subtitles, this was when I started thinking about this idea.
What it does
This website allows users to upload any video, and through the use of Google Cloud machine learning services, received a dubbed copy of that video in a language of their choice.
How we built it
The app was built with a Django back-end and VueJS front-end. This was integrated with Google Firebase for data storage and authentication, alongside Google Cloud's text and audio-based machine learning services to provide an accurately dubbed version of the video.
Challenges we ran into
Figuring out how to integrate all the Google Cloud services was a challenge for us, as we are both still quite new to machine learning and firebase services. We also ran into issues trying to figure out how to correctly parse the audio from the video files, and use that audio with Google Cloud's machine learning.
Accomplishments that we're proud of
- I managed to dub English video to 4 other languages.
- Managed Stay on the free tear of google cloud
What we learned
- Things are harder than they look.
- How to use the google cloud platform and Its APIs.
- How to use google firebase for authentication and data storage
What's next for AI-Assisted Auto Dubbing
With enough time and resources, I might be able to turn this project into a startup