Songcraft

Make your first song without knowing any music theory. Songcraft suggests the chords, beats and notes that fit, can turn humming sounds into a melody, and lets Gemini polish it like a producer.

Comment

Inspiration

Due to the difficulty of learning music theory and music production software, I wanted to create a gateway software for those new to making music to be able to create decent songs consistently

What it does

Songcraft guides beginners through making a song one step at a time: the beat, the chords, the melody and the lyrics. At each step it suggests what fits the theme of music you want to make and explains why. You can hum a melody and it gets fitted to your beat and key. Gemini acts as a producer you can ask for changes like "make it sadder", and it gives feedback on your lyrics and a final check before you share. The finished song can be downloaded, and none of the audio is generated by AI.

How I built it

React, TypeScript and Vite on Vercel, with Tone.js and real instrument samples for the audio. Humming is turned into notes with pitchy. Gemini runs on Google Cloud through Vertex AI, using Gemini 3.1 Pro and 3.6 Flash for the producer, planning and feedback, and Gemini 3 Pro Image for the app's art.

Challenges I ran into

The biggest challenge was making music theory feel simple for someone who has never made a song. My first version turned beatboxing into drums, but it was hard for most people to use, so I rebuilt it as a guided beat builder. Getting humming to line up with the beat also took a lot of tuning.

Accomplishments that we're proud of

I built a tool that someone with no music experience can now make a full song in a few minutes and understand why it sounds the way it does, and the song is still their own.

What we learned

I learned that beginners don't need fewer options in music production, just a little guidance on which options would fit the song they want to make. I also saw how helpful AI can be when it supports your creativity instead of replacing it.

What's next for Songcraft

Right now Songcraft is built for beginners, and the next step is making it just as useful for experienced producers. That means exporting MIDI and separate tracks so a song can be finished in a full DAW like Ableton or FL Studio, a pro mode that hides the guidance and opens up the full piano roll and mixer, and support for importing your own samples and using a MIDI keyboard.

For everyone, I want to add more keys, chord types and song sections such as a bridge, per-track effects like EQ and reverb, accounts to save songs, and the ability to open a friend's shared song and remix it.

Built With

Share this project:

Updates

Submission history