Providing an accessible music experience for the hard of hearing.
What it does
Alongside a standard music playing experience, HAV provides a visual and haptic experience through either a web, mobile, or Augmented Reality.
How we built it
The backend service was build using AWS and the Capitol Records API provided by 7Digital. The web experience was built using Ionic, Vibration API and the Web Audio API. The AR experience was built using Unity.
Challenges we ran into
Agreeing on an idea Streaming the audio through Unity Building the visual waveform
Accomplishments that we're proud of
Web haptic and visual waveform AR modeling and textures Reuse of Node.js backend
What we learned
Working with audio data Using Vibration API and the Web Audio API Unity
What's next for HAV (Haptic Audio Visualizer)
Real-time lyric streaming Enhanced animations A VR solution