HAV (Haptic Audio Visualizer)

Inspiration

Providing an accessible music experience for the hard of hearing.

What it does

Alongside a standard music playing experience, HAV provides a visual and haptic experience through either a web, mobile, or Augmented Reality.

How we built it

The backend service was build using AWS and the Capitol Records API provided by 7Digital. The web experience was built using Ionic, Vibration API and the Web Audio API. The AR experience was built using Unity.

Challenges we ran into

Agreeing on an idea Streaming the audio through Unity Building the visual waveform

Accomplishments that we're proud of

Web haptic and visual waveform AR modeling and textures Reuse of Node.js backend

What we learned

Working with audio data Using Vibration API and the Web Audio API Unity

What's next for HAV (Haptic Audio Visualizer)

Real-time lyric streaming Enhanced animations A VR solution

Built With

• amazon-web-services
• capitol-records-api
• ionic
• lambda
• node.js
• unity
• web-audio-api