Polyglotté

Polyglotté Real-time Translator

Inspiration

Do you dream of your kids flipping between 2 languages and your grandma is able to read the Japanese letters when she is traveling in Tokyo?

If that’s what you are into, you should start encouraging them to start learning a foreign language. However, the kids learned in school are in the book, and are not very fun...

The human brain is a wonderful thing. From the moment we are born, we learn by six main ways, by

Sight
Taste
Smell
Sound
Touch
Doing.

We have built a web-based tool that can help people learn a language by connecting these ways. Imagine you hold a cup of hot coffee which smells really good, and now the computer tells you how to speak and display "coffee" in five different languages. You will learn this word very quick efficient.

What it does

The Polyglotté web tool opens the camera on your laptop to obtain an image. Based on your choice, either to detect the object or text in the image, it translates the word into five different languages.

How we built it

We use HTML and Javascript to build a scene inside the webpage and stream from real time webcam
Ajax
OpenCV

- Machine learning

Challenges we ran into

Communication between the image captured by webcam, backend computation, and display

Accomplishments that we're proud of

This is a very useful tool that we built for kids to encourage them to learn more languages, which can open another world for them
This tool is also very helpful for people who are traveling around the world, without input the words by hands, a simple realtime camera can be your guide