de_Cipher

We'll de_Cipher your drawing into music! The sound is as unique as the drawing you give. The process couldn't be simpler - even if the math isn't!

Comment

About de_Cipher

Inspiration:

We were inspired by a math Youtuber named 3Blue1Brown, and his ingenious use of math as a tool for education and elucidation in his videos.

What it does:

Our web application will turn the user's image or drawing into sound. The user may draw an image on the canvas pad or upload a rasterized image to turn it into sound.

How we built it:

We built this in python, JS, HTML, and CSS. To start, we needed a large amount of research, both technical and theoretical. Once that was done, we designed using NumPy libraries and original art for our front end. Once we had a good handle on the libraries and functions, the actual implementation came together very quickly.

Challenges We Ran Into:

  • Resizing and centering canvas on GUI using HTML. We faced some difficulty when trying to resize and center the canvas pad for drawing on top of the static background image.
  • Understanding NumPy's FFT library Specifically, translating theoretical and mathematical concepts into concrete code.

Accomplishments That We're Proud Of:

  • Frontend: creating & repositing buttons on a static image using HTML.
  • Backend: Getting a bitmap of an image and using that to generate sounds
  • Frontend: getting the drawing tool working, getting images to load, and connecting the line.
  • Backend: engineered our own Fourier decomposer
  • Overall: Successfully turning our shapes into sounds!
  • Overall: Completing the basis of our web app.

What We Learned:

  • How to manage and work within a software development team using Agile Development methods.
  • Working with a drawing tool in JavaScript and making a website with an arcade layout.
  • How to implement NumPy to get define the mathematical theory into code.
  • Creating .wave files using Scipy.
  • Parsing and manipulating images. Most of all, we learned how to be a team and deliver our product in a set amount of time.

What's Next For de_Cipher:

Looking forward, we want to complete the development of our app, copyright and secure our intellectual properties, and create more interesting modules for our application. We have many ideas for how we want to expand on our project such as more features, full web app capabilities, and mobile capabilities. Our app can be used by everyone from kids interested in music and programming to seasoned musicians who are always looking for a new compositional tools. We also hope to work with UMBC affiliates in order to inspire new generations to engage in STEM and programming.

Tools/Resources We Used:

Share this project:

Updates