Sonify

Inspiration

When I first started learning music, I did not have strong resources or clear guidance. I spent an excessive amount of time searching online for sheet music, explanations, and ways to adapt songs to my own level and style. That experience inspired me to build Sonify: a tool that makes music creation and customization much more accessible.

What it does

Sonify is an AI-powered music copilot that can generate sheet music based on the user’s ideas and musical preferences. It also provides AI assistance to help users customize the generated music, such as changing style, structure, and musical feel, so the result is more personal and usable.

How we built it

We built Sonify by combining AI-generated music workflows with sheet music rendering and editing tools. The system takes user prompts, generates music content, converts it into a readable music format, and allows users to further refine the result through AI-powered assistance and customization features.

Challenges we ran into

One of the biggest challenges was generating music that feels like a real piece instead of just a sequence of notes. We also ran into difficulties making the output customizable enough, while still keeping the music coherent, readable, and musically meaningful.

Accomplishments that we're proud of

We are proud that Sonify turns music creation into something much more approachable for learners, creators, and casual musicians. We also built a system that goes beyond simple generation by letting users interact with the music and shape it with AI assistance.

What we learned

We learned that generating good music is not just about producing notes, but about structure, harmony, expression, and user control. We also learned that users want more than automation—they want a creative partner that helps them refine and personalize their music.

What's next for Sonify

Next, we want to improve the musical quality of the generated pieces, especially by making them less repetitive and more expressive. We also want to expand Sonify’s customization abilities so users can make deeper changes to harmony, accompaniment, mood, and arrangement while keeping the process simple and intuitive.

Built With

• abc-notation
• musicxml
• next.js
• openai-gpt-4o
• opensheetmusicdisplay-(osmd)
• react
• salamander-piano-samples
• tone.js