Humming

• 

  Starting page with orchestra mode off

• 

  Starting page with orchestra mode on

• 

  Listening

• 

  Result page

Inspiration

I often have the urge to create something musical, but those small “aha” moments disappear very quickly. For people without years of musical training, it can also be very hard to turn an idea into actual music.

Most of the time, we don’t want to create something grand or professional. We just want to make something meaningful, light, and personal.

That is why I came up with the idea of building an application that helps people create music in a simple and intuitive way.

What it does

This application mainly does three things for us.

Listen to your humming

Application will record your humming, noise filtering it, and correct it. AI plays a big part in noise filtering, it effectively "ignores" the noise to extract only the musical intent.

Understand your emotion in your humming

Yes — this application can understand emotion from your humming.

The intervals in your humming can go up or down, be wide or small, and these patterns all carry emotional meaning. The texture of your voice also matters, such as how soft, tense, or expressive it sounds.

By combining these features, the application can understand how you want your music to feel. This step is very important, because we don’t want to build just a music converter — we want to create music that feels emotional and human.

Generate music based on your emotion and humming

This is what the user finally hears.

Based on your humming, the detected emotion, and whether orchestra mode is turned on or not, the application generates music for you. The instrument (such as piano or flute) is mainly chosen based on the emotion of your humming.

You can save the music and share it with others later.

How we built it

This project is completely done on Google AI studio.

Challenges we ran into

The main challenge was my lack of music domain knowledge. I am not very familiar with musical concepts like tones, keys, or different instruments, which made the development process more difficult.

Accomplishments that we're proud of

I am very proud of the application can tell the emotion in your humming, that is the heart and soul of this application.

What we learned

The biggest lesson I learned is to always pay attention to small ideas.

Even if an idea seems simple, silly, or useless at first, modern technology can make it possible. These small ideas and small inventions can still bring real joy to people’s lives.

What's next for Humming

There are several directions to explore:

Deciding whether to make the application more social, such as letting users post their humming or share musical ideas At the same time, music can be very personal, so keeping the app simple and private might be better — this is something worth experimenting with.

Continuing to improve the AI model so it understands humming more accurately.

Adding more instrument options.

Built With

• audio
• gimini
• multimodal
• musicsynth
• ts
• understanding