SignTrans

Click on mic button and speak and to convert click on hand sign button.
It will show the hand signs according to the letters.

Inspiration

The main inspiration behind this application is to remove the communication barrier for Deaf-mutes. Hearing loss or deafness has a direct impact on communication, educational achievements, or social interactions. Lack of knowledge about Deaf culture is documented in society as well as in the healthcare environment. So we tried to close that barrier with this app which helps us to easily interact with Deaf people using sign language.

What it does

People can use this app on their phone to convert their voice/text into Hand Sign Language to communicate by showing Hand Signs generated with people having a hearing impairment. People with hearing loss can use this app to act as a listener which can then convert voice into readable text sentences or generate its translated Sign Language.

How we built it

We build this app using android studio, its code is written in kotlin, and to design the user interface we used XML code after that for voice recognition we used a class to work with Android speech recognition Authored by Aleksandar Gotev, for displaying hand signs we simply used and font in which all characters are stored in hand sign form.

Challenges we ran into

We specifically remember when we tried to iterate each letter in the string sentence, We couldn't use the Thread.sleep() function as it was causing the whole app to freeze. So we used numerous methods of using Handlers, Thread functions and finally figured it out with some help from StackOverflow posts.

Accomplishments that we're proud of

We are proud of the Kotlin app that we created as this is our first working kotlin project for most of us. We learned a lot about creating UI elements in Kotlin. Finally, we are happy that we can create an app that can actually help folks to communicate with Deaf people.

What we learned

-For most of us it was the first Hackathon, also the first time using Kotlin. -Sharing our ideas and how to collaborate to reach our goal. -Challenging ourselves by learning new skills in a short amount of time. -How to put our skills to work in a quick-turn environment.