Inspiration
Originally, we didn't have a clue what our project could be. We were a team of mostly beginners with no prior hackathon experience. So, we started with the only thing we could do, and that was getting to know each other. We found that we all liked music and most of us had played instruments before, and the idea grew from there.
What it does
Our program Rhythm Judge grades piano players on the accuracy of their playing. By allowing users to scan their sheet music, Rhythm Judge is able to recognize the notes being played and inform the user of any mistakes they made while scoring them accordingly. Overall, it is meant to be a tool musicians can use to aid in their practice.
How we built it
We built the program the program primarily in Python, with the front-end part utilizing HTML. Furthermore, we modified a tool called sheet vision for music scanning, as well as building an audio processing tool that could analyze pitch and tone. AI was implemented throughout the process to help with timeliness, calculations, and debugging.
Challenges we ran into
One of the biggest issues with the audio analyzer was that it was sensitive to frequencies and would detect and lock onto the third harmonic of a note whenever a fifth overtone occurred. In order to solve this as much as possible our math had to be adjusted to account for this problem. Another issue was importing a tool into Python using Windows PowerShell but luckily were able to solve this
Accomplishments that we're proud of
Our team was proud that despite this being our first hackathon we were effectively able to divide the labor based on our individual skill sets. Because of this we all contributed to the project in a variety of meaningful ways.
What we learned
We all immensely furthered our knowledge in both Python and music theory. Alongside this, we now know what to expect at a hackathon and how to take advantage of the opportunity for future networking.
What's next for Rhythm Judge
Rhythm Judge seeks further improvement so that it can handle detecting multiple notes at once and handle multiple different instruments.
Log in or sign up for Devpost to join the conversation.