Tamil speech to text

Inspiration

Since visually and hearing impaired people having tough time in communicating with the outside world we created a website that allows them to communicate with their surroundings

What it does

For visually impaired, their voice will be taken as input and it will be converted into text and that will be sent to the intended user For hearing impaired, the required audio will be converted into text so that they can read and respond correspondingly It can convert audio to text from both video and image and we can retieve the stored text in database with the help of user defined title

How we built it

• Separate platforms for hearing and visually impaired
• With the help of javascript API, the audio will be converted into the required text for hearing impaired
• For visually impaired their audio will be converted into text so that it is easy for the intended users to reply
• Added translation and downloading functionality for the converted audio
• Storing in backend using PHP and Mysql

Challenges we ran into

• Faced some issues while connecting with backend
• Javascript API doesn't respond correspondingly

Accomplishments that we're proud of

• Visually and hearing impaired people can use our website so that they can communicate with each other without any hesitation
• Even if the intended user could not understand Tamil, we can translate into their respective language. Like multilingual.

What we learned

• We learnt how to use Javascript API, how the request is being sent and thebcorresponding received
• How backend technology actually functions and how it is actually stored in database

What's next for Tamil speech to text

• Till now we provided functionalities like coverting audio to text, translating, storing and retrieving text, retrieving text from video
• Here we can retrieve the text only using user defined title. We are working on semantic search (i.e., Keyword search). There will be no need to have user defined title

Built With

• javascript
• mysql
• php
• python