Inspiration

Generative AIs like ChatGPT and Midjourney have revolutionized the creative world, establishing a paradigm based on textual inputs. However, for music and video production, this approach may not be the most optimal. Prompting remains a challenge for many users.

GenreX has designed the first-ever video-to-music creation system, allowing users to bypass the need for prompts and create music by directly uploading or selecting the video clip they are working with.

What It Does

GenreX Video-to-Music AI transforms your video into music. Users can simply upload a video clip or select it from their editing interface on Canva. Our system processes and analyzes the video content, extracting information to generate a music track that pairs seamlessly with the clip.

How We Built It

Our team comprises talented visual-audio AI researchers and engineers. We first built our AI model and then used the Canva SDK to create intuitive user interfaces and experiences.

Challenges We Ran Into

We faced challenges in improving the music generation speed to reduce waiting times. Ensuring our system's stability and reliability was also crucial and difficult.

Accomplishments That We're Proud Of

We are proud to have delivered the world's first-ever video-to-music generative AI. This innovative feature facilitates music creation for videographers and is now available to the Canva community.

What's Next for GenreX Video-to-Music AI

  • Faster generation speed
  • Enhanced video analytics
  • Multi-track music generation
  • More control on generation: audio expansion, inpainting, and editing

Built With

Share this project:

Updates