Inspiration
I was inspired by the difficulty of coming up with ideas, and how at times its easy to get stuck in a idealess mindset as an artist. I believe AI can really help with this process and make it more efficient.
What it does
The AI comes up with ideas for songs. Furthermore, you can make it write song lyrics for you.
How we built it
It was built on react and node.js with frontend and backend, and for layout mostly css and typescript to make it more solid. Google's Gemini Nano AI model was chosen as the LLM by using the general-purpose generative language model by using "window.ai" to connect with the AI. The page
Steps
"window.ai.languageModel.create" calls the Gemini Nano API, given the AI model is embedded within the users browser.
A session is created with specific parameters (e.g., temperature, topK) to interact with the model. In this case the two parameters are fixed at certain values to assure a more streamline response.
"session.promptStreaming(prompt)" then streams responses from the AI model for the given prompt, which is then filtered to make it comprehensible for the user.
Challenges we ran into
The biggest issue by far, and honestly the only one that held me back, was filtering the response of the AI and writing the prompt such that it does not return chaotic or messy responses. I also had difficulties with time management as I am a full time Economics student and have to dedicate time for exams.
Accomplishments that we're proud of
The fact that I managed to make it run on the website, and that it responds with good and understandable answers.
What we learned
I learnt how important prompting is for AIs. I also learnt how to adjust AIs, based on K and temperature, and how it can really impact responses, but also be an advantage if you want a less streamline response and more creativity.
What's next for MusAi
MusAi will stay on the website, in the future I hope to make it a lot more advanced where users can choose genre, mood, simplicity, etc... and the AI will write based on that.
Log in or sign up for Devpost to join the conversation.