Communication is the start of all conflicts and resolution of all problems. Therefore, it is of the upmost importance that your message is delivered clearly and effectively. Here at Aud-See, we pride ourselves on giving all people the opportunity to make sure that they are heard and understood. After countless hours of brainstorming, problem solving, and relentless grinding, we could proudly sign our names on the masterpiece that is Audi-See. We would like to express our gratitude towards Qhacks for enabling us to expand our horizons, challenge the norm and create something that could potentially enhance the lives of millions.

What it does

For those who having hearing impairment, are new to the English language, or those who may be slower at the comprehension of language, Audi-See is a great means for communication. It empowers these groups in their daily lives. Audi-See is a communication and presentation tool. It uses an Android app to record live speech, and in real time, the speech data is sent via a database, to a website, where the speaker's words are prominently displayed for viewers. This allows anyone listening to the speaker to read off of the captions of the live speech, and keep up with the conversation or presentation.

How we built it

We built Audi-See using an Android app, a Firebase real time data base, and a localhost Website. The android app, written in Java, used special permissions to record audio data. It then processed and translated the audio into readable text and sent it over wi-fi to a Firebase database. The website would retrieve all speech data sent to the database, after being notified by an event listener that new data is available, using Javascript. To display the speech text and all design related elements on the site, Html and Css were used.

Challenges we ran into

This project was full of challenges that were persevered through. After many different brainstormed ideas, the idea of a communication tool to help those who have trouble with hearing or the English language, resonated with the group. All members went far out of their comfort zones in order to make Audi-See come to life. Challenges ranged from learning new programming languages and syntax, to clearing the speech buffer. A large issue was attempting to properly call 3rd party APIs and having them correctly send and retrieve data. Moreover, the user interface design on the website, was also quite a challenge for a group of math-doing engineers.

Accomplishments that we're proud of

We are proud of everything and every team member this weekend. We all managed to stay awake to the very end and finish the ambitious project on time. We are proud of how well we worked as a team, and how much fun we had together. We attended workshops, tried new things, learned so much, and met so many brilliant fellow hackers. We are proud that we came out of QHacks making a real attempt at impacting the world with our project.

What we learned

We learned that you should always be on your toes. When one thing doesn't work, you just keep trying until you get to the end goal, and make a meaningful project you are proud of.

What's next for Audi-See

Audi-See can expand its horizons to cover a broader spectrum of audio and understanding. In future Audi-See will be able to live caption songs and music. That would allow users to experience music with full comprehension. As well, Audi-See can expand its horizons to real time translated captions. This would allow those with difficulty in any language, to comprehend speech live in their native tongue. The possibilities are great, and Audi-See is just getting started.

Share this project: