DeTalk: Bridging Communication for All

Inspiration

As an international student, I understand the importance of staying connected with family through online video and voice communication. However, relatives with impairments often face barriers in accessing these platforms. To bridge this gap, we created DeTalk, a platform designed to make communication accessible to everyone, regardless of their abilities.

What it does

DeTalk bridges the communication gap for people with disabilities, making online interaction accessible and seamless for those who are visually impaired, speech impaired, or deaf.

How we built it

We built the platform using Flask as the web framework, integrating sign language recognition and text-to-speech functionality. We utilized custom-built datasets and Deep learning models to enhance the accuracy of our sign language recognition system.

Challenges we ran into

Existing datasets for sign language recognition were either too complex or inaccurate for our needs. To address this, we created our own dataset using RoboFlow and custom scripts to ensure better quality and precision for our application.

Accomplishments we're proud of

We’re proud of building a functional web application that not only allows communication between people with disabilities but also creates a custom sign language recognition model that is more reliable and accessible. Our collaborative effort in overcoming technical challenges has resulted in a meaningful, impactful platform.

What we learned

We learned the importance of working with reliable, tailored datasets for Deep learning, as well as the complexities involved in integrating multiple technologies (e.g., Flask, sign language recognition, and text-to-speech). We also gained valuable experience in UI design and building a user-friendly platform.

What's next for DeTalk: Bridging Communication for All

Next, we plan to improve our dataset and enhance the accuracy of our sign language recognition model. We also aim to expand the platform's capabilities, including integrating text-to-speech and speech-to-text functionalities, and developing multilingual sign language support to make DeTalk even more accessible for a wider audience.

Built With

• css
• deeplearning
• html
• javascript
• pyflask
• zegocloud