Inspiration
After witnessing a digital divide in our own community in the bay area that affected students who have visual/hearing impairment in schools, our team felt inspired to create an environment where they can learn with comfort and find fulfillment through the education system. Our goal was to allow this group of students to stay competitive and up to date with the competitiveness of the current educational era.
What it does
Our solution implements two models. One model is named Vision AI, is trained to detect similarities in text and objects to read them out load to a visually impaired user. Our ASL AI model is trained to detect sign language to help translate the language into words for non ASL users to understand.
How we built it
We built our solutions using Python, HTML, CSS, OpenCV, Mediapipe, Matplotlib, Scikit-Learn, PyPi.
Challenges we ran into
It was difficult to implement the python into our HTML website initially, and our team struggled with aestheticizing our website as well. We also struggled a little bit with understanding how to train the model to recognize different hand gestures.
Accomplishments that we're proud of
Our team is proud that we were able to get two working models within the given time limit as well as present out solution in a simple, easy to understand, but also interactive method through both a slide presentation and a website.
What we learned
We learned how to collaborate as a team and collaborate through tools including GitHub Desktop. We learned how to overcome differences of opinions and work on our pitching and public speaking skills as well. We also learned to focus on designing our idea rather than just focusing solely on brute force code.
What's next for inclusive.edu
- Our first future plan is to enable notifications for unrecognizable objects/text to directly notify us of extra AI training that must be implemented to enhance the quality of the AI image recognition
- Our second future plan is to add text manipulation to support other forms of visual impairments including but not limited to synesthesia and color blindness
Log in or sign up for Devpost to join the conversation.