Conductor: Your AI Music Co-Pilot

Inspiration

In the world of music production, inspiration can be fleeting and technical hurdles can stifle creativity. I were inspired to create Conductor, a web-based Digital Audio Workstation (DAW) that removes the friction from the creative process. I envisioned a tool that acts as an intelligent partner, helping artists go from a spark of an idea to a full-fledged composition seamlessly. The goal was to build a DAW that you can talk to, making music creation as natural as a conversation.

What It Does

Conductor is a modern DAW with a twist: it's powered by a conversational AI assistant. Here’s what you can do:

  • Full-Featured DAW: Conductor provides a familiar and powerful music production environment right in your browser. It includes a multi-track playlist, a piano roll for MIDI editing, a virtual mixer, and transport controls.
  • AI-Powered Music Generation: This is where Conductor shines. Simply ask the AI assistant, "Conductor," for what you want, and it will deliver. You can request:
    • Chord Progressions: "Generate some chords for me."
    • Melodies: "Can you write a flute melody over these chords?"
    • Drum Patterns: "I need a trap beat with a heavy 808."
    • Specific Instruments: "Make a pattern with a trombone sound."
  • Intelligent Sample Swapping: Don't like a sound? Just tell the AI. "Change the kick drum to something punchier." Conductor will find a suitable sample from its library and swap it in.
  • DAW Control via Chat: Control the essentials without clicking around. "Play the track," "Stop the music," or "Set the tempo to 140 BPM."

How I Built It

Conductor is built on a modern, robust tech stack:

  • Frontend: Next.js and React provide a fast, component-based UI, styled with Tailwind CSS.
  • AI & Backend Logic: The "Conductor" assistant is powered by OpenAI's GPT-4.1 model. User prompts are sent to a Next.js API route, which communicates with the OpenAI API to generate intelligent commands.
  • State Management: I used Zustand with an immer middleware for predictable and efficient state management of the entire DAW—from patterns and playlist items to track volumes and mutes.
  • Web Audio Engine: The core of the DAW's audio capabilities is built on Tone.js, a powerful framework for creating interactive music in the browser. It handles everything from sample playback and scheduling to tempo and transport control.
  • MIDI & Sample Libraries: The musical knowledge base comes from a curated library of MIDI chord progressions and a structured library of audio samples, allowing the AI to generate harmonically and rhythmically interesting content.

Built With

Share this project:

Updates

Submission history