Inspiration
I was inspired to build SignAI because I noticed a major barrier in communication for people who are deaf or non-verbal. I have a brother who is deaf and cannot speak, which made communication challenging for both of us. I realized that many others face similar difficulties, so I wanted to create a tool that could help bridge this communication gap using AI and technology.
What it does
SignAI allows users to perform gestures and have them identified in real time by an AI model. It helps learners: Communicate using sign language. Practice basic educational concepts interactively, such as: Addition: \� 2 + 1 = 3\ Multiplication Spelling exercises Letters and numbers recognition It works through a web interface using a webcam, making it accessible and interactive.
How we built it
Dataset Collection: Collected a dataset of sign language gestures. Data Processing: Cleaned and formatted the dataset to train the AI model. Model Training: Trained a model to recognize and interpret gestures in real time. Web Integration: Integrated the model into a web platform with a webcam interface for live interaction. Challenges we ran into (https://youtu.be/Lc1qgNDwXhI?si=awCJ4E7QGuEQ92pi)
- Limited Datasets: High-quality sign language datasets are rare and often imbalanced.
- Model Accuracy: Ensuring the AI could reliably identify gestures in real time was difficult.
- Integration: Combining AI models with a smooth, responsive web interface required optimization and testing.
Accomplishments that we're proud of
Successfully trained an AI model to interpret sign language gestures.
- Built an interactive web platform with live gesture recognition. Enabled users to learn and communicate through AI-assisted sign language.
What we learned
-Practical experience with AI model training and dataset handling. How to integrate AI models into a web application. -The importance of accessibility and interactive learning for inclusive education.
What's next for SignAI:
Accessible Virtual Education for Deaf Learners Expand the gesture dataset to cover more signs and improve accuracy. Add more interactive learning modules and games. Explore mobile integration for broader accessibility.
Log in or sign up for Devpost to join the conversation.