Chroma

• 

  A calmer frame.

• 

  An active frame.

Chroma is a passion project. I wanted to have fun this weekend while staying committed to the challenge of learning. This is something I've wanted to build for months, something I had no idea where to begin with, something I wanted to undertake alone.

This is my story.

Chromesthesia is a kind of synesthesia, or blending of senses, where one's brain involuntarily associates colors with arbitrary sounds - something my brain has always done. My dream was to hack on a HoloLens and build an app experience that simulated what I see on an everyday basis. I ran into hardware incompatibility issues with my OS very quickly. I then resolved to make an iOS app that leveraged AR to achieve that same goal. I soon learned that that would not be simple either, as several useful kits had not migrated from an older version of Swift. My last resort was to build a cross-platform application of sorts, but one problem remained: I am a backend programmer with little experience coding visually appealing aesthetic experiences.

Frontend and graphics may not be intuitive to me; however, I am persistent and resourceful. I curated a few open-source examples and tutorials of mobile and web applications that leveraged the Fourier Series to perform wave reductions and discrete mathematical formulas to perform real-time audio analysis. I was determined to understand the theory behind these computations and how/why they worked before I moved forward. The resulting code is largely from an open-source personal project from an individual named Samuel Lapointe - which was originally commented entirely in French. I stepped through it, re-explained its functionality in English, and toyed with some parameters so the simulation felt closer to my personal perceptions.

While this hack does not aim to solve a larger overarching goal in society, it serves as a guidepost on my journey toward expanding my technical horizons and satisfying my curiosity.

Thank you for coming along.

Built With

• love
• physics
• processing.js