Inspiration

Our group member Raman's Grandma has recently lost her hearing. This has made it hard for Raman to be able communicate with her. We developed this so that using ASL, Raman's Grandma can have an easier time having "verbal" conversations with his loved ones.

What it does

It has 3 main features. Text to ASL, Speech to ASL and Live Speech to ASL translation.

How we built it

We built this using React, Git and Microsoft Azure Speech to Text.

Challenges we ran into

When we tried to make this application, we couldn't find any public databases of videos of people signing words. We overcame this by making 300+ videos of us signing ASL.

Accomplishments that we're proud of

We were able to work together and stay focused throughout the entire 24 hours while also getting to enjoy all the events hosted by HooHacks. We are also very proud of our use of 3D animations for our website.

What we learned

We learned how to make 3D websites, interactive UX and alot about the struggling with hearing loss go through.

What's next for Talk To The Hand

We want to show this product to Raman's Grandma and hopefully help her still enjoy her time with her family despite her hearing issues.

Built With

Share this project:

Updates