MP3 to MTV

• 

  MP3 to MTV - Generative AI Music Videos

• 

  Audio -> Speech Recognition -> ChatGPT as Video Director -> Stability Image generation -> Music Video

Inspiration

Musicians who create music may with to have entertaining videos to accompany their music

What it does

The app allows the user to enter a music file and have an automatically generated music video

How we built it

Built in Python using Visual Studio Code and Colab

Challenges we ran into

Always difficult to find the right libraries and get them to work together

Accomplishments that we're proud of

What we learned

Many learning experiences from many different types of GenerativeAI. OpenAI Whisper Speech recognition, ChatGPT, image generating like Dall-e and Stable Diffusion plus video animating tools.

What's next for MP3 to MTV

Using MIDI and Audio without lyrics as input. Adding animated morphing videos. Create animated graphics. Add video effects.

Built With

• langchain
• openai
• python
• stability