Signscribe

Inspiration

In our school, Ngee Ann Polytechnic, we had a session with people in "dialogue in the dark." Which is a place that teaches us how people who are blind sees the world. By experiencing that, we felt very sorry for them as we previously did not know of the struggles they were going through. Therefore, by creating this application, we hope to be able to make their lives easier as we know that sometimes, it is very difficult for a blind or deaf person to communicate with us.

What it does

Our innovation makes use of the ever-growing artificial intelligence to identify different sign languages given by people with disabilities to the camera. By doing this, those people are able to communicate more efficiently with other people and they will feel more inclusive. Our app also uses voice recognition to convert voice to letters on the screen. Potentially helping out the deaf community as well. The main goal of our app is just to be able to cater to people with disabilities and help them feel more comfortable talking with other people.

How we built it

We used flask frameworks to build a UI that is meant for phone usage so users can use it whenever they want. We used an abundant of css,html,javascript and python just to incorporate artificial intelligence into a website and for users to interact with the website

Accomplishments that we're proud of

We are proud of being able to create a website from scratch using html,css and javascript as we had very limited knowledge on those prior to thus hackaton.

What we learned

We have learnt to be able to work as a team and to distribute tasks accordingly to each member's strength. For example, if he/she is better at doing backend servers rather than fronted, we should allocate him/her to the backend

What's next for Signscribe

We hope to be able to improve and learn more o artificial intelligence to further improve our ai data model and also to improve the accuracy of said hand signals. We also hope to be able to incorporate our local languages such as the singlish sign language into our ai data training model.