Do you dream of your kids flipping between 2 languages and your grandma is able to read the Japanese letters when she is traveling in Tokyo?

If that’s what you are into, you should start encouraging them to start learning a foreign language. However, the kids learned in school are in the book, and are not very fun...

The human brain is a wonderful thing. From the moment we are born, we learn by six main ways, by

  • Sight
  • Taste
  • Smell
  • Sound
  • Touch
  • Doing.

We have built a web-based tool that can help people learn a language by connecting these ways. Imagine you hold a cup of hot coffee which smells really good, and now the computer tells you how to speak and display "coffee" in five different languages. You will learn this word very quick efficient.

What it does

The Polyglotté web tool opens the camera on your laptop to obtain an image. Based on your choice, either to detect the object or text in the image, it translates the word into five different languages.

How we built it

  • We use HTML and Javascript to build a scene inside the webpage and stream from real time webcam
  • Ajax
  • OpenCV

- Machine learning

Challenges we ran into

  • Communication between the image captured by webcam, backend computation, and display

Accomplishments that we're proud of

  • This is a very useful tool that we built for kids to encourage them to learn more languages, which can open another world for them
  • This tool is also very helpful for people who are traveling around the world, without input the words by hands, a simple realtime camera can be your guide

What we learned

  • Teamwork
  • Creative thinking
  • There is more can be done to help the community

What's next for Polylatte

  • Account
  • IOS app
Share this project: