Communication has always been a part of everyones' lives, no matter who you are, or where you come from. However, even in the year 2015, we still have an extremely difficult time communicating with the rest of the world. This app was inspired by the desire to be able to communicate with people who we might otherwise find impossible to communicate with.

What it does

Hello-World is a mobile application that detects your speech and displays subtitles over a live stream. The app opens up to a live video stream and will detects when someone is speaking. As soon as it detects speech, it translates that speech to the subtitles in the language of your choice. In addition, we used sentiment analysis on the content of the speech to determine whether the speech was positive, negative, or neutral.

How we built it

We built it using Android Studio and Microsoft Translator libraries to build the android app and translation functionality. We utilized Indico API's for the sentiment analysis.

Challenges we ran into

One big challenge we ran into was getting the translation to work. After we had gotten the speech recognition, we needed to translate that data into the desired language, but doing so proved difficult because of the complexity of various API's we've tried to use. We did eventually find a solution with a library based on Microsoft Bing Translator. Also, we could only implement speech recognition of English, and not other languages.

Accomplishments that we are proud of

After having four people work more hours than I can count on the same problem, we found a solution to translating the speech.

What we learned

We learned about how to send HTTP GET requests from android, various Android development, how to use Indico API's, and how difficult some API's can be to use.

What's next for Hello-World

-Support for detection of more languages -Support for displaying more language-subtitles -Continuous detection of speech. -Creating this app on other platforms- Oculus, AR, etc.

Share this project: