Hearo

Let’s reduce inequality. Together.

Comment

Inspiration

I was inspired by my grandmother, who lost her hearing with age. I noticed how she struggled with simple but important things — not hearing the doorbell, not noticing the kettle boiling, or feeling unsafe when alone at home. Seeing her frustration made me realize how much Deaf and Hard-of-Hearing people are excluded from everyday communication and safety. This personal experience motivated me to create a solution that could bring independence, confidence, and dignity back into their lives.

What it does

Hearo is a mobile app that: Recognizes over 520 sounds (sirens, glass breaking, baby crying, etc.) with TensorFlow Lite YAMNet with 92% accuracy. Alerts users through vibration, flashlight, and notifications even when the phone is locked and no Internet. Provides speech-to-text chat and ready-made flashcards for everyday communication. Sends daily positive messages to support emotional well-being.

How we built it

We built Hearo in Android Studio, integrating YAMNet for on-device sound classification. We combined: A sound recognition module with customizable alerts. A real-time speech-to-text engine for easy communication. A UI/UX design focused on accessibility and simplicity. All processing happens locally on the device to ensure privacy.

Challenges we ran into

Adapting sound recognition to noisy local environments. Creating a simple design that’s intuitive for all ages. Lack of existing localized solutions for Deaf communities in Central Asia. Ensuring data security without relying on cloud storage.

Accomplishments that we're proud of

Building a working MVP that already helps users feel safer. Designing features directly with feedback from the Deaf community. Combining multiple tools — sound alerts, communication aids, emotional support — into one accessible app.

What we learned

We learned how to integrate machine learning into mobile apps, design with accessibility first, and test features with real users. We also discovered how technology can advance UN Sustainable Development Goals like Reduced Inequalities (10), Good Health & Well-being (3), and Innovation & Infrastructure (9).

What's next for Hearo

Expanding to iOS and smartwatches. Adding gesture recognition and more localized sounds. Partnering with schools, NGOs, and Deaf organizations. Scaling to other regions in Central Asia and beyond.

Built With

Share this project:

Updates