We hope to bridge the communication barrier that often exists between people who are not able to speak and those who do not know American Sign Language (ASL). Like the Roman goddess, Minerva, herself, we seek to make help people become more intelligent by making the transfer of information more readily available.
What it does
Eye of Minerva takes images of ASL hand signs and applies a machine learning model we trained ourselves to determine message behind each hand sign and translates that to text. That model, which is hosted on Google Cloud, is sent through a Flask application to an Android application on a phone. The user can translate the ASL into a language of their choice (ie. French, Spanish, etc.) and can output that translation audibly via text-to-speech on their phone.