transilate

iOS View

Inspiration

Given that it takes time, dedication and energy to learn a language it may be inconvenient for everyone to do so before entering a foreign business meeting or travelling to a foreign country. Although there are translation apps out there, the pause between capturing the clip and waiting for a response can create an unwanted pauses during the conversation.

What it does

The app is intended to listen actively for conversation and play it back to the user as audio in their chosen language (native to them) such that a conversation doesn't need to be interrupted.

Since we hadn't finished the implementation, it acts as a proof of concept with a projected solution for language barriers between people.

How we built it

The app was built in React Native so that it may appeal to iPhone users and Android phone users.

Challenges we ran into

Given that our team had limited experience with using React Native, it was challenge to create it from the ground up and work out the bugs. In addition, installing the speech to text server code was heavy weight due to dependency on CUDA.

Accomplishments that we're proud of

We were proud that we learned more about different topics shown in the hackathon, ML, and React development as a whole in addition to the different intricacies involved in creating a real time application.

What we learned

We learned to work as a team and combine our different strengths despite having different backgrounds.

What's next for transilate

Looking for improved language processing algorithms would decrease the time gap of latency between the speech of the person being recorded and the listener (user) hearing them in their native language.

Project link: https://github.com/jasminejinny/transilate