CAL • POLY • GLOT©

AR Translation
Prototype hardware

Using real-time MSER image processing via OpenCV, Tesseract OCR, and Microsoft's Translate API, this device is able to detect, recognize, and translate foreign language and then display the translations over the original text, using an Augmented Reality platform. Using the Raspberry Pi, coupled with Microsoft's Speech and Translate services, this device is also able to translate the wearer's speech, concurrently as it is spoken, as well as foreign speech the wearer hears.

This device may be used to improve communication and understanding. Individuals that travel to other countries can become more familiar with foreign language. And as the US becomes a richer melting pot of various cultures, it may also be useful in social gatherings here in the US. An eventual goal would be to incorporate sentiment analysis using facial image processing to determine more contextual and cultural meanings of what people are saying.

Thank you for your consideration.