Tactify

Inspiration

The internet connects billions, but it still does not include everyone. many people who rely on sign language, people who are deaf or hard of hearing, and people who face communication barriers online often struggle to interact smoothly in digital spaces. We wanted to fix it by making this extension to help those who fit this general statement.

What it does

Tactify is a web extension that transforms how people who use sign language communicate online by using its built-in camera to recognize ASL and other sign languages and translate them into clear English text in real time.

How we built it

Tactify works by using its built-in camera to capture the user's hand movements and gestures while they sign. The extension sends these movements through an AI model that has been trained to recognize ASL and other sign languages. The model identifies each sign, interprets it in context, and then converts it into clear English text that happens in real time, allowing users to communicate naturally through signing while others read the translated text instantly.

Challenges we ran into

Some challenges we ran into were things like changing the main idea of the extension, and not being able to create the correct code to easily detect the right letters from our hand signals.

Accomplishments that we're proud of

We had trouble creating the camera and adding it to our system, so by being able to add the camera to our extension, we were finally able to fix one of the huge errors we found in this huge project.

What we learned

We learned that many simple mistakes could ruin the whole code. For example, when we were working on the CSS portion of our extension, the box for the detection of the hand was detecting the wrong portion of our video, but by fixing the proportions in the CSS part, we were able to fix it.

What's next for Tactify

In the future, we could improve Tactify by expanding the range of sign languages it recognizes, making it faster and more accurate in real time, and adding support for group conversations and video calls. We could also explore ways to integrate with more websites and platforms, providing customization for different learning styles, and enhancing accessibility

Built With

• chrome
• css
• github
• html
• javascript
• libraries