• 

  Create Music with AI, Effortlessly

Inspiration

We were inspired by the challenge of making music creation accessible to everyone. Music theory can be intimidating, and we wanted to build a tool that removes that barrier. We imagined a space where anyone, regardless of their background, could visually explore musical ideas and even collaborate with an AI to spark their creativity.

What it does

HarmonySketch is a creative co-pilot for musicians. It lets you visualize music theory concepts like scales and chords on an interactive canvas, allowing you to build melodies by simply dragging and dropping notes. It also features an AI-powered Sonic Sketchpad, where you can type a simple prompt like 'a chill lofi beat' and have a unique musical idea generated for you instantly. You can then take that AI creation and refine it on the canvas.

How we built it

We built HarmonySketch with a modern web stack. The front end is crafted with ReactJS, tailwind CSS, shadcn, firebase. For requesting the AI model we used gemini API and overall backend is serverless.

Challenges we ran into

Our biggest challenge was translating text prompts into musically meaningful output from the AI. It took a lot of work to design the right prompts and parse the AI's response into a format that can be played correctly. We also focused heavily on creating a smooth and intuitive user interface for the Melody Canvas, ensuring the interaction felt seamless.

What's next for Harmony Sketch

Our vision for HarmonySketch is just beginning. The next step is to build out our Pro tier, offering users a vast library of advanced scales and modes. We plan to add features like MIDI export, so musicians can take their creations into professional DAWs, and introduce more high quality instrument sounds. We're also excited about the possibility of adding collaborative features in the future.

Built With

• firebase
• gemini
• react
• shadcn
• tailwind
• tone.js