Smart Language Assistant

• 

  Start Page

• 

  Image Celection/Capture

• 

  Translation 1

• 

  Translation 2

A day in the life of a non-native individual will tell us how difficult it could get at times due to the language barrier. As an individual whose mother tongue is different than the most commonly used language in public places, understanding the signboard in public that are not written in the language he is most comfortable with, could be a challenging task and may even prevent him from accomplishing basic tasks.

1.1 Problem in Hand: The problems we have identified mostly relate to the everyday life of a non-native speaker who has to dead will signboards and instructions in common public places written in languages far from his understanding. These may include but are not limited to, challenges in reading parking place instructions, grocery stores special discounts, children’s diary book that has teacher’s comments, warning instructions at public places for possible danger, etc.

1.2 Our Proposed Solution: As computer science students who have understood the strengths to which technology has impacted life, we aim to solve this problem by leveraging on the advancement of smartphones, natural language processing, and other applications of Machine Learning. Mostly simply put we aim to develop a mobile application that helps non-native speakers in understanding instructions from signboard at public places written in English (or other) language, by recognizing the characters from the image, identifying the language that is written in and translating to the native language of choice.

Built With

• automl
• google-cloud-vision
• javascript
• react-native
• tesseract.js