Inspiration
As the developer of the Music Maker app on Canva, I discovered that our users were generating music for different cultures/geographies; for example, Indian, Spanish, K-Pop themed tunes. Along with music, voice and words have always been one of the most powerful storytelling methods; finding a way to help creators get their words heard around the world was the inspiration behind EasyDubbing.
As global communication becomes increasingly important, we noticed a gap in the Canva apps marketplace for tools that allow content creators to effortlessly translate and dub their videos into multiple languages, while retaining their own tone and voice. We wanted to create a solution that would empower creators to reach a broader, more diverse audience without the complexities and high costs traditionally associated with video localisation.
What it does
EasyDubbing is a powerful tool that allows content creators to dub their videos into multiple languages using advanced AI technology. By simply uploading a video and selecting the desired target languages, users can generate high-quality dubbed videos that maintain the original content’s tone and emotion. EasyDub also offers features like video history tracking, support for various languages, and seamless integration with Canva, making it an all-in-one solution for global content distribution.
How we built it
EasyDubbing was built using a combination of modern web technologies and AI-driven solutions. The Canva applicaton leveraged the Canva Apps SDK documentation and starter kit. For the back-end, we integrated leading AI models and APIs, allowing for accurate and natural-sounding dubs in over 30 languages.
To reduce the burden on users, we implemented Frictionless Authentication, ensuring that users can easily dub their Canva-created videos directly within the app without any additional authentication hurdles.
In order for our app to be financially sustainable, we have implemented a subscription model using Stripe to help cover the costs of infrastructure and video storage.
Challenges we ran into
We had to navigate issues related to handling large video files, managing API rate limits, and maintaining the quality of the user experience while ensuring that the integration remained fast and responsive.
Another significant challenge was improving the user experience. We wanted to create an intuitive and simple interface that would allow users to dub their videos with minimal friction. This involved multiple iterations of the UI design, usability testing, and refining the user journey to ensure that every step, from video upload to selecting target languages, was as straightforward and efficient as possible. Balancing advanced AI functionality with an easy-to-use interface was a delicate task, but we ultimately succeeded in creating a seamless experience for our users to so they can generate dubbed content with the click of a button.
Accomplishments that we're proud of
We are incredibly proud of the fact that we successfully created a tool that democratizes video localization, and made it accessible to content creators of all levels to help their content reach the world.
The seamless integration with Canva and the user-friendly interface we developed are key achievements, as they ensure that creators can easily expand their content’s reach without needing specialized skills.
Additionally, the positive feedback from our early users has uncovered the wide range of personas EasyDubbing supports, including teachers, small business owners, marketing teams, and even enterprises for localising internal training and marketing material.
What we learned
Throughout the development of EasyDub, we learned the importance of user-centric design and iterative development. Listening to feedback from the Canva app review team provided invaluable feedback to make the user experience simple yet delightful. We also gained valuable insights into the complexities of AI-driven video processing.
What's next for EasyDubbing
EasyDubbing is in the final stages of the app review process and aims to be live for users within the next week. Our aim is to make EasyDubbing the simplest, yet most powerful application on the Canva apps marketplace for content creators and enterprises to tailor their content for a global audience. This includes support for additional languages, audio-only dubbing, Multiple-speaker voice extraction (separate individual speaker voices into separate audio files and dubbed languages), and subtitle/caption generation.
Log in or sign up for Devpost to join the conversation.