PictureGuitarPlayer

Python&Java
Command line argument
Averaged grayscale image with higher resolution and longer music time
Averaged grayscale image with lower resolution and shorter music time

Inspiration

Music is the inspiration of life, and source of great artwork. We want to combine the essence of music with image - two possibly unrelated things from two different dimensions - with computer program. Our program does this metaphysical transformation by mapping image data to sound data and plays it out loud.

What it does

It firstly converts our colorful image into gray-scale image. Then it divides the image into consecutive blocks and averages out the gray-scale for each block. Mapping the averaged gray-scales to musical notes, the program is able to play those notes out with our implementation of guitar strings.

How we built it

We use Python to do data processing for the image and Java to plays the music.

Challenges we ran into

We were building our program in a cross-platform manner, so a key challenge that we ran into was to execute python file in a java program. Besides, the implementation of the guitar sounds also required special knowledge about frequency and pitch of musical notes.

Accomplishments that we're proud of

We can hear the picture through our program.

What we learned

We learned how to process image and audio in python/java.

What's next for PictureGuitarPlayer

We want to incorporate packages that can be used to recognize people's face(i.e. face key points like mouth, eyes, nose, etc.). The program will generate different pieces of music for different parts of our face. In that way, we can hear from our inner self through computer interpretation!