My younger sister is deaf and now has a cochlear implant in both ears. The thing she was most afraid of losing was music. We wanted to create an application that would make music enjoyable visually, so hearing or not, songs could be enjoyed with one's eyes.

What it does

This app aims to visualize how music sounds & feels on the screen (almost like dancing!). It uses the Spotify API to connect a user to their large library of songs. The user can search and choose a song and then iterate through different visualizations until they find one they like the best.

How I built it

We used: the Spotify API, p5.js, Express.js, Node.js, jQuery, Ajax, React.js, JavaScript, HTML, Nunchucks, & CSS.

Challenges I ran into

It was very difficult to implement the search functionality as well as link the visuals with the tracks from our requests to the Spotify API. We spent a lot of time working to pass the track's url to the p5.js visualization and also to implement the user's ability to go through different visualizations with the press of a key.

Accomplishments that I'm proud of

This combination of art and technology brings something very important many communities that can appreciate it: artists, designers, technologists, musicians, etc. We managed to bring our idea to life with a lot of research and hard work.

What I learned

Collaboration is key & wonderful projects happen at the intersection of art & technology!

What's next for HEART: hear art // experience music

More visualizations & more users! We want everyone to experience music in this new way.

Share this project: