Signify

Inspiration

The inspiration for the project came from observing the lack of support for people with disabilities. We choose to focus on bringing an equal footing for death and/or mute members of society. Small actions can go a long way!

What it does

Signify:

Provide a fun and educational way to learn sign language and bring together different communities.
recognizes a subset of sign language through the phone camera and translates the gesture to a letter.
translates a word into a set of hand gestures.
Explore a dictionary that displays the ASL alphabet with a quiz feature, which allows a user to guess the gesture.

How I built it

Our mobile application is built using Microsoft Azure Custom vision and the newest Apple framework SwiftUI. Azure was used for training, testing multiple iterations of ML image processing. Given the short period of the event, it allowed achieving advanced ML techniques without extensive prior knowledge.

Challenges I ran into

We were struggling with internet access and creating a live video feed for the phone camera. Azure definitely removed some of the heavy lifting in our workload.

Accomplishments that I'm proud of

We made an app with the feature that isn't available on app stores. It is nice to know that it could potentially help a lot of people when we continue to work on our project.