Note: Our project does not work.
But the real DJ Fourier is the convolutions we made along the way and was inside of us all along. It's about the discriminator and stereo FFTs, not the destination.
Our AI experts have never worked on generative AI before. Our sound engineer has never engineered sound before. Our webdesigner has never worked with python on a webpage before.
Inspiration
Ever thought of a really cool melody but just couldn’t seem to continue it? It’s okay, not everyone is Mozart, and definitely not everyone is DJ Khaled. But with a little generative AI, maybe you can be! (the latter)
What it does
The user uploads a 10 second melody in a .wav file into the front-end of our web application. It then creates a longer piece based on your melody - a variation on your theme, if you will. For creative infringement reasons, this program should be used on new melodies, and it will be trained on Bach. If you want to write in the style of a modern artist, just be creative lol. We’re not here to take away work from musicians.
How we built it
The frontend part was built using HTML and the styling was done using some CSS and JavaScript. For the backend we used Python mainly with Pydub, NumPy, SciPy, TensorFlow and Keras. To tie it in with the backend we used Flask.
Challenges we ran into
Not everyone has perfect pitch or even a crystal clear voice so we implemented ‘autotune’ and noise filtering in python to make sure our AI is getting a clean input. There are also a limited amount of notes the AI can choose from and still sound good. We did not get around to training it lol
Accomplishments that we're proud of
We are proud that we were able to make a somewhat functional autotune from nothing but numpy, scipy and the power of friendship.
What we learned
We learned how to do frontend, sound engineering in Python, generative AI and implementing GAN models.
What's next for DJ Fouried
Due to time constraints, DJ Fouried is only capable of atotuning melodies. but we plan to make it work lol. On the frontend side, it would also be fun to learn how to design a better web application with Figma.
Log in or sign up for Devpost to join the conversation.