HearMe

• 

  interface

• 

  inside the project

• 

  permission and warning

Inspiration During a graduation ceremony of one of the universities without any warning one of the students had gone to one of the hospitals and he signed a weird sign to the doctors, but no one understands him and because doctors cannot determine his medical condition and did not take his history. The student passed away when the student's family reached the hospital, they told doctors that he was deaf! , What if one of the doctors know the sign language? He would save the student alright. That's why I made this application! What it does HearMe is a real-time mobile application that translates sign language into readable text. Using a custom-trained Machine Learning model, it bridges the communication gap between the deaf community and the hearing world instantly. How we built it Flutter: For a seamless, cross-platform UI. Canva: To design a surrealist, user-friendly UX. Kaggle: To source high-quality datasets for Arabic and International sign languages. Teachable Machine: To train and export a robust TFLite model. Challenges we ran into -Learning Curve: This was my first time building and integrating a Machine Learning model from scratch. -Technical Hurdles: Overcoming camera recognition lag and managing hardware memory constraints (like Disk Space and RAM issues) during the build process was a major challenge. -Accuracy: Fine-tuning the model to recognize signs under different lighting conditions. Accomplishments that we're proud of Successfully building a functional, AI-powered healthcare solution independently. Transforming a conceptual idea into a working prototype that can truly help people. What we learned I gained deep insights into the AI training pipeline, how to optimize Flutter apps for real-time image processing, and the importance of perseverance when facing complex environment errors. What's next for HearMe Expanding the dataset to include full sentences and dynamic signs. Adding support for more regional and international sign languages. Integrating Text-to-Speech (TTS) for a truly two-way communication experience. *slides * https://drive.google.com/drive/folders/1PLagIb7UArIemZm8hFRJTwkJii729Vnl

Built With

• flutter