Gamified Auditory Training for Hearing Rehabilitation

The app offers gamified auditory training for those recovering from hearing loss, with modules for speech-in-noise, memory, and 3D sound to enhance listening skills.

Comment

PRESENTATION: https://www.canva.com/design/DAGZXIfbKrc/d2948uZJ_iWmB43gR2Gijg/view#8

Inspiration

Rehabilitating hearing capabilities requires engaging, effective, and scientifically backed training methods. Traditional approaches lack interactivity, making it harder for users to stay motivated. Inspired by the need for accessible and enjoyable auditory rehabilitation tools, we designed an app that provides multiple auditory training games for individuals recovering from hearing loss or surgeries.

What it does

Our app offers a suite of six gamified auditory training modules:

  • Sound Guess by Who: Users listen to animal or object sounds and guess their source based on audio clues.
  • Speech in Noise: Challenges users to recognize and understand speech embedded in background noise, simulating real-world scenarios.
  • Rhythm Training: Users match or identify rhythms to enhance timing and auditory synchronization.
  • Reaction Time: Tests how quickly users can respond to auditory stimuli, improving focus and auditory reflexes.
  • Auditory Memory Game: Strengthens auditory memory by challenging users to recall sequences of sounds.
  • 3D Sounds: Immersive auditory training using spatial sounds, helping users localize and identify sound sources in a three-dimensional space.

The app focuses solely on delivering these experiences without added features like leaderboards or scores, keeping the design simple and lightweight.

How we built it

Framework and Tools

  • Developed using Flutter for an efficient, platform-agnostic build.
  • Incorporated audio libraries such as AudioPlayers for precise sound rendering and management.

Game Logic

  • Designed simple interfaces for each game, ensuring clarity and usability for users with minimal tech expertise.
  • Utilized algorithms to simulate speech-in-noise challenges and spatial audio in 3D games.

Optimization

  • Focused on app size reduction by optimizing assets and avoiding redundant libraries.

Challenges we ran into

  • Time Management: Balancing the development timeline with the need for high-quality features.
  • Better Testing: Ensuring all auditory games function as intended across diverse devices.

Accomplishments that we're proud of

  • Developed an app with real-world therapeutic applications in hearing rehabilitation.

What we learned

  • Audio Engineering: Gained insights into sound design, spatial audio, and noise simulation.
  • User-Centric Design: Learned to simplify interfaces for accessibility while ensuring functionality.

What's next for Untitled

  • Game Enhancements: Add more auditory exercises, such as tone differentiation or language-based challenges.
  • Clinical Testing: Validate the effectiveness of each game through trials with audiologists and users.
  • Accessibility Features: Introduce options like adjustable sound frequencies or noise levels for tailored experiences.
  • **Multilingual Support

Built With

Share this project:

Updates