Inspiration
People who are deaf or hard of hearing likely have a difficult time speaking which means that it could be difficult for them to use translator apps. We combined our technical knowledge and awareness of this problem to create a form of google translate that incorporates video capture to transcribe ASL.
What it does
Allows a user to translate between ASL and any other language, works on the ASL alphabet. It also supports speech-to-text and text-to-speech.
How we built it
We used Google Translate and Google Text To Speech APIs with a Flask backend and simple front end with CSS, HTML, and JavaScript.
Challenges we ran into
Getting an accurate vision model, converting text to speech, converting speech to text, and converting between languages proved to be challenging problems. Fortunately we were to resolve them.
Accomplishments that we're proud of
Managing a complex project with many different disciplines and technologies.
What we learned
Learned more about training image classification models & computer vision, full stack web dev, using TTS, STT and translation APIs .
What's next for ASL Translation Aid
Adding support for words and phrases.
Built With
- css
- flask
- git
- github
- google-text-to-speech
- google-translate
- html
- javascript
- python
- yolo
Log in or sign up for Devpost to join the conversation.