Inspiration

Inspired by our passion for a variety of different music, and our interest in R3F/3D web-based rendering. The game design is highly inspired by the Steam game, Audiosurf

What it does

ALlows the user to drop an .mp3 file in or select from a database of creative commons songs. Afterwards, it generates a 3D track and targets to the beat/rhythm/length of the song.

How we built it

React 3 Fiber frontend layer, ExpressJS for the API layer, and MeydaAPI for the Digital Signal Processing.

Challenges we ran into

Originally was gonna use spotify API, but they discontinued the use of http (enforce https), which disables from testing on the localhost server.

Accomplishments that we're proud of

Generating a 3D track mapped entirely to the audio of the input file.

What we learned

A lot about digital signal processing, and rendering 3D components in the R3F Canvas component.

What's next for SoundSurf

Ideally, we'd like to implement further effects, and integrate native WASM DSP code, as unfortunately we were out of time and needed to offload that to the Meyda API.

Share this project:

Updates