withU

WithU is a lifesaving app for the deaf, detecting emergency sounds and alerting users with vibrations, flashing lights, and a voice message to ensure they’re never left behind.

Comment

WithU – Emergency Assistant for Deaf and Hard-of-Hearing

💡 Inspiration

Emergencies can strike anytime, but for deaf and hard-of-hearing individuals, being unaware of danger due to the inability to hear alarms or sirens can be life-threatening. We were inspired to build WithU to ensure that no one is left behind simply because they couldn’t hear the warning.

⚙️ What it does

WithU listens for emergency sounds like fire alarms and sirens, then alerts the user through strong vibrations, flashing lights, and an on-screen warning. It also plays a loud pre-recorded voice message saying, "Take me with you, don’t leave me behind" to get the attention of those nearby.

🛠️ How we built it

WithU is built using React Native with Expo, leveraging mobile device capabilities such as:

  • Microphone access for sound detection
  • Vibration API for haptic feedback
  • Camera flash for visual alerts
  • Audio playback for the assistance message We used accessible UI design and ensured all features work offline for reliability.

🧱 Challenges we ran into

  • Building continuous and lightweight sound recognition on-device
  • Ensuring alerts are perceivable in various lighting/noise conditions
  • Balancing battery usage while listening in the background
  • Designing a UI that is accessible and language-inclusive

🏆 Accomplishments that we're proud of

  • Creating a fully functional emergency assistant for the deaf community
  • Making the app work offline with real-time alerts
  • Designing an intuitive, inclusive interface that requires no user setup in emergencies

📚 What we learned

  • The importance of inclusive design and real-world accessibility
  • How to integrate multiple device APIs for seamless feedback
  • The power of simple, human-centered solutions in saving lives

🚀 What's next for WithU

  • Add detection for custom sounds (e.g., name calling, honking)
  • Enable emergency alert messages from local safety authorities
  • Integrate with smartwatches and wearables
  • Partner with humanitarian organizations for deployment in crisis zones

Built With

Share this project:

Updates