SignSync

• 

• 

  Checking Answers

Inspiration

Most people either don't know sign language at all, or only know how to sign the alphabet (in order). Our inspiration for this project was increasing communication and inclusivity. The site is an easy way to learn or improve sign language ensuring that you will be able to have some level of communication with people who are deaf.

What it does

When the site is open, the webcam on your computer is pulled up. This provides a live feed of yourself so that you can check the signs you are making. Underneath the live feed, there is an option to input your own letters that you want to practice. You can do these signs in the webcam, and then hit the 'check answers' button to see if you did the right signs. The 'check answers' button pulls up a string of images corresponding with the correct sign. You can also generate a random string of letters if you want more randomized practice.

How we built it

We used react, css, and javascript.

Challenges we ran into

We wanted to implement a pre-trained model that checks for accuracy, but we were unable to figure out FastAPI in time. Also, we had doubts about being able to implement a model that checks signs more accurately than a human could check themselves.

Accomplishments that we're proud of

This was our first time using react, and it turned out really well!

What we learned

We learned how to use react, and we improved our css and javascript skills. We also learned the ASL alphabet along the way.

What's next for SignSync

In the future, we hope to implement a model that checks for accuracy of your signs. We also want to add a speedrun mode so people can time themselves on how fast they can sign.

Built With

• css
• javascript
• react