YouDub

Watch videos on YouTube with new English voices to make listening more pleasant. Enables accessibility to videos created solely in different languages with its automatic English translate feature.

Comment 2

YouDub: Expanding YouTube Accessibility Through Customizable Voice-Overs

Our inspiration for developing YouDub came from a unique blend of experiences within our diverse team. With three members having Hindi as their mother tongue and one member being an English speaker, a casual conversation revealed an interesting challenge. Our English-speaking teammate shared his fondness for math tutorials taught by Indian educators, who often explain concepts in an incredibly straightforward way. However, these videos were mostly in Hindi, which meant he had to rely on subtitles to follow along.

This sparked the idea: What if we could create a Chrome extension that adds voice-overs to YouTube videos, allowing viewers to hear a dubbed version of the content in their preferred language? Not only would this help break language barriers, but it would also assist students who struggle with videos where the accent is hard to understand, the pace is too fast, or the explanation style is unclear. By providing customizable voice-overs, YouDub enhances accessibility, making it easier for users to engage with educational content.

What We Learned

Throughout this journey, we learned a lot. On the technical side, we gained expertise in designing and building a Chrome extension, integrating APIs, and refining our use of Git for collaborative development. Beyond the code, we learned the value of teamwork, developed stronger friendships, and discovered fascinating things about each other’s perspectives and working styles.

Stack and Functionality

YouDub is built using JavaScript, HTML, and CSS. We leveraged ElevenLabs API, first feeding transcription data from YouTube videos into Google Cloud API's translate feature, and then into Eleven’s voice models, generating synchronized audio in the user’s chosen voice. This opens up various use cases, such as replacing the voice of a content creator whose delivery might be off-putting, or translating and dubbing tutorial videos, allowing users to immerse themselves in the content without relying on subtitles. The result is a more engaging experience and access to a broader range of content on YouTube.

Challenges We Faced

Building YouDub wasn’t without its challenges. One of the biggest hurdles was defining the exact scope of what we wanted to achieve. YouTube’s frequent updates to its site security also presented difficulties, causing multiple console errors that required extensive debugging. Additionally, the demanding pace of development, especially during CalHacks, pushed us out of our comfort zones, requiring long hours and constant problem-solving.

Conclusion & What's next

The experience was incredibly rewarding. We leave CalHacks not only with a functioning product but also with a sense of pride and accomplishment in what we’ve achieved.

In the end, YouDub empowers users to engage with YouTube content in new and exciting ways, breaking language barriers and enhancing the viewing experience for people around the globe.

With our extension in review to be publicly available on the Chrome Web Store, our product will soon be available to users around the world!

Built With

Share this project:

Updates