Harmoniq

Inspiration ✨

When you look to play a piece of music from a video or an audio file, it can be difficult to find sheet music with the right key, notes, or chords that you need to make your music come to life. Harmoniq eliminates those struggles and allows you to transpose your files into playable music.

What it does

After uploading an audio or video file, Harmoniq utilizes Gemini API to detect key notes and chords with proven musical ratios and mathematical formulas, which it then transposes into music readable to users.

How we built it

• API calls to Gemini to optimize music file to frequency conversion
• Node.js to manage server-side files ## Challenges we ran into
• Ensuring accurate transposition based on note frequencies
• Working with large datasets of notes with millisecond breakdowns ## Accomplishments that we're proud of
• Built a working prototype that converts audio into playable music
• High accuracy in chord recognition ## What we learned
• Performance vs accuracy: Managing large files and datasets and ensuring optimal performance for users ## What's next for Harmoniq
• Sheet music generation and formatting
• Lyric extraction
• Separate musical parts for users who play different instruments

Built With

• css3
• google-gemini
• html5
• javascript
• node.js