Inspiration
We wanted to make music more assessable with an instrument that can be played without touching anything
What it does
The Magic Mouse senses the angle and distance of a target, relays it to a computer running a web app.
How we built it
We developed a custom circuit board that combines the LIDAR sensor with a Raspberry Pi microcontroller. The microcontroller is programmed in C++ and it identifies the closest target to the sensor, and relays the information over a virtual serial port to a computer, running a web app written in JavaScript, HTML and CSS. The webapp parses incoming data, visualizes it on a canvas and generates tones that create beautiful music
Challenges we ran into
We had many challenges that we overcame. Parsing serial data from the LiDAR sensor was not easy due to the strict timing requirements of asynchronous serial communication.
Accomplishments that we're proud of
We are proud of communicating with the LiDAR and handling the big data it generates. We also fitted our hardware in an elegant, repurposed enclosure.
What we learned
We learned a lot about UART and serial communication
What's next for EmBEDded Magic Mouse the musical
We want to make note detection more accurate so that even more sophisticated songs can be played, and a more decorated ui/ux.
Log in or sign up for Devpost to join the conversation.