We wanted to begin to learn Chinese while we were in Taiwan but had no idea how! It can be overwhelming to start learning vocabulary from scratch, especially if most of the words aren't initially relevant to you. If only there was a way to customize the words you learn to match what you actually see and interact with in the world...

Here's how Twig works: You take a picture. We identify what's in the picture using a combination of image segmentation and Wolfram Technology's awesome image identification. Then we use Microsoft's excellent translation service to translate the picture into whichever language you're working on learning. You can save the picture, translation, and .wav files with recordings of the translation for later review.

Made with Objective C + image segmentation + Wolfram Cloud + Microsoft Translate :)

Share this project: