Subtitles with Dictionary Search, Image Search, and Video Timestamp Navigation
General Video View
According to the British Council's research, there are approximately 750 million English learners as foreign language speakers (EFL) and 375 million English as Second Language speakers (ESL).
I remember my close friends and family members struggle with learning English as a second language.
With the evolving nature of technology, videos have augmented the learning landscape. So, I chose to augment the existing Youtube Subtitle system with tools that can assist an intermediate English learner while they are enjoying a Youtube video.
What it does
Our web application fulfills our goal of creating a passive learning experience for English learners.
I created an improved version of Youtube's subtitles system where the user can hover over any word and get the definition, translations, and various images of that word. In addition, the user can click on any word and get redirected to the specific time stamp that correlates to it.
How I built it
I built this by using the Youtube API to extract video subtitles, Yandex's Translation API to extract translations of words, and Merriam Webster's Dictionary API to extract definition of words.
I programmed our own unique subtitle system where the user could navigate the video by clicking on certain words in the transcript. I made this using AJAX.
For connecting the various APIs to our web applications, I used JSON parsing among other things.
Challenges I ran into
I ran into a lot of issues with the Youtube API since there was no documentation on how to use/maniupulate Youtube captions. Also, for connecting the APIs to our web app, I ran into issues such as caching data results.
What's next for Watch & Learn
I plan to implement a more engaging platform with personalized data analytics, more accurate subtitles, and grammatical help (with natural language processing).