RhythmMaster

• 

• 

  Gameplay

Inspiration

I was inspired by games like osu!, rocksmith, rockband, and simplypiano

What it does

Its a game to teach you piano in a gamified way that uses multiplayer to play together with your friends.

How we built it

I used react and bolt to get me started. After that I did some research on how to play sound font, and ended up landing on using the Spessa Synth library to play the sound fonts and midi. For multiplayer i used photon js which is a library that games like Stumble guys, Among Us VR and pixel gun have used very easy to use. The multiplayer piece is not in this release but will be next one.

Challenges we ran into

Syncing the audio with playback of sound font was one of the hardest part of this project this took a lot of trial and error but we got there, building my own library, trying other people's libraries. Most of had todo with libraires not being low level enough to not have access to mute tracks/see voices etc... Had to read a lot of the internal code of Spessa Synth to understand how it was working and made my own midi parser and stuff to extract instruments for some bits.

Accomplishments that we're proud of

Got a fully working proof of concept working showcasing playing my favorite songs

What we learned

I learned a lot about how Soundfonts works and midi. Learned to not underestimate some processes and to get a better idea of what need cause lots of rabbit holes had to go down .

What's next for Rhythm Master

I plan adding leaderboards, user profiles, rankings, as well as a more polished multiplayer system with some different gamemodes like vs or play together or something

Built With

• react
• spessasynth
• typescript
• vite