38-SignSync (Real Time AI Sign Language Translator)

Application Logo

Inspiration- SignSync: Signs understood. Instantly.

SignSync represents more than just a technological solution—it's our commitment to bridging social divides through innovation. At its core, SignSync is driven by a vision of bringing deaf and hearing communities closer together through mutual understanding. Our real-time AI sign language translator doesn't simply convert gestures to text; it creates pathways for genuine human connection across traditional communication barriers. We believe technology should serve humanity by making the world more accessible and inclusive for everyone. With SignSync, we're not just translating languages—we're translating experiences, emotions, and ideas that deserve to be shared without limitations. Join us as we work toward a future where communication knows no boundaries, and where understanding flows freely between all people, regardless of how they communicate.

What it does

We aim to convert sign languages and gestures into real time text and speech. The application takes the video feed from the device's camera and takes note of the hand gestures as well as making key detail to finger position and location. This in turn helps to determine what sign language gesture the user is performing.

How we built it

This application was built utilizing the python framework DJango, we also took advantage of the framework's packages to run models and conditions against the input from the camera to determine the gesture of the user.

Challenges we ran into

We ran into a few challenges which include converting our original codebase to a web application as alot of the service in the framework we decided to use were not working. We did however find a breakthrough utilizing Django.

Accomplishments that we're proud of

We are proud to have reach very far in interpreting the user's gestures and being able to accurately determine the user hand gesture. We believe with continuous work, this application can change the operations as it relates to communication in alot of different industries.

What we learned

Technology as a bridge, not just a tool: Creating meaningful connections between communities requires focusing on human experience beyond technical functionality. Framework selection is critical: The pivot to Django proved essential for overcoming implementation challenges and successfully processing gesture inputs. Accessibility requires accuracy: The precision of hand tracking (capturing 21 landmarks) directly impacts the reliability of communication, making technical excellence an ethical imperative. Rapid prototyping limitations: 24-hour constraints highlight the need to focus on core functionality first while maintaining a clear vision for future development. Cross-disciplinary knowledge matters: Effective sign language translation requires understanding both technical capabilities and the nuances of how deaf communities communicate.