People with hearing loss cannot listen to music. We want to improve their experiences by enabling them to visualize music, so that they’re able to interact with it using a different sense.
What it does
In the project folder, the user uploads an audio file, which our program then processes to store the amplitude and frequency of the audio at each instance of time. The program analyzes the frequency of the sounds to determine the hue of the colors and the amplitude to determine the size and number of the forms visualized. As an entire song is parsed through, exciting and vibrant animations are generated live as they convey the changes in the technical qualities of the music. Its results are both aesthetic and informative for the user.
How we built it
Challenges we ran into
Accomplishments that we're proud of
What we learned
We learned how to incorporate functions from the p5 sound library to generate a user-interactive experience and different ways to analyze audio.
What's next for Music You Can See
We would like to expand on our audio visualizer in a few ways. For example, The user uploads an audio file directly onto the website, which is loaded into our program, and its mood or genre, which determines the color family of the visuals.This implementation would allow the program to incorporate different color families for their emotive qualities in order to convey the meaning of the music, in addition to its technical qualities, to the people with hearing disabilities. Another way to further develop our project would be to educate the users about the frequencies of the song by transcribing them into music notes.
Log in or sign up for Devpost to join the conversation.