- Motivation: Every new person in a foreign country needs to speak the local language as a basis for integration. Without it, those people could be simply isolated! Sydney hosts residents from more than 188 different birthplaces with 182 languages spoken.
Top 5 countries of origin Philippines India New Zealand Fiji England
Project: This project aims to provide a cheap device that contains a camera that can teach the words from a local language to the native language of the refugee. This can allow the person to learn the vocabulary of the new language in his/her daily life easily
How to: By using a pair of cheap smart glasses, I process the camera input with deep learning techniques for object recognition. Afterwards, a translation api is used to obtain the new language word. Then, another api for pronunciation is used to obtain the right pronunciation in the other language. Finally, everything is integrated over wifi.
Tasks: Management of Cameras Object Recognition Translation in writing Translation in Audio Communication in real time Implementation of a web interface to see the results Implementation of an audio capability
Challenges I ran into: Quantity of individual steps. It is pretty challenging for the short time of the hackathon.
Accomplishments that I'm proud of:
Object recognition
Translation over a wide range of languages
Pronunciation in a wide range of languages
Web Interface terminated
Working on computer!!!
Next Step: Connection with the real glasses over internet
What I learned: Many technologies to accomplish the final product
What's next for TranslaGlass Expansion and mass production of the cheap device to help a high quantity of people
Log in or sign up for Devpost to join the conversation.