Inspiration
The hearing disabled population relies on reading lips/ and gestures or text conversation for communication. Due to the outbreak of covid, work from home become the new normal. Meetings are conducted via zoom and social gatherings via gather town. The nature of online communication may disadvantage the hearing disabled population in employment opportunities, as not all people turn on their camera during meetings, speech to text transcription is not available on most of the conference call software and the quality of the camera may affect communication.
In light of this, we would like to build a web plugin for real-time speech to text in meetings/ interviews and real-time hand gesture conversion to audio.
Ideally, this would facilitate communication and enhance the employment opportunities of the disabled population.
What it does
It helps deaf people to effectively participate in online meetings by converting audio to text.
How we built it
We brainstormed on the idea and built the mock-up using HTML, CSS, and JavaScript.
Challenges we ran into
Different timezones and the complexity of the problem were a bit challenging.
Accomplishments that we're proud of
We were able to demo what we built.
What we learned
Thinking about the technology and its access to all. The advantages and disadvantages of the pandemic. Building a project in a team.
What's next for Sound Wave
Identifying hand gestures and convert to audio or text.
Log in or sign up for Devpost to join the conversation.