Demonstrating sign recognition
Our webapp can also be used to learn sign language
Correctly doing the "L" sign
Incorrectly doing the "L" sign by doing an "O" instead
Having others try to spell "Hello"
What is our Inspiration
We were inspired to work with people with disabilities, Sydney has a neice that is developmentally disabled and she has always wanted the opportunity to integrate her love for the community and her love for programming so we came together as a team to make that dream a reality.
What we built
Machine learning is a topic of great interest in the tech community for quite some time and is something our team an members have been looking forward to working with. We built a web based application that recognizes sign language from visual input that we taught clarfai and outputs the text and audio corresponding with each letter.
How we built it
Challenges we ran into
Effectively collecting data points for our various models and being able to parse through the results to retrieve the correct letter.
What we learned
Clarifai API, Neural networks, Artificial intelligence, and image recognition technology.