Senses

• 

  homepage

Inspiration

Wanting to give people a new way to learn languages. Since we both come from international families we believed in something that would help new people in a foreign country.

What it does

It is a mobile app that lets you take a photo and receive and receive a quick audio and text response of the content of the photo in the language of your choice.

How we built it

The app is built using the javascript framework for mobile apps, react-native. We used a flask server as well as the google apis (vision, speech, translate) to process the user requests from the app.

Challenges we ran into

We ran into several problems managing the transfer of image and sound binary files between the server and the user. We would've liked to have more time to work on the UX Design as well.

Accomplishments that we're proud of

Having just met this weekend, we were able to form a team and finish the complete project within 24 hours since we started on Saturday.

What we learned

Besides all the languages we were able to learn through our app, we also developed great teamwork skills working with someone new for many hours straight. This was also a great experience for our first hackathon

What's next for Senses

Our next steps are to assist the visually impaired to identify what their surrounding objects are.

Built With

• flask
• google-cloud
• google-web-speech-api
• javascript
• python
• react-native