Pillar Category: Entertainment

Inspiration:

We wanted to explore how technology could make playing music more accessible for people with arthritis or limited hand mobility.

What it does:

Air Guitar uses a webcam to track hand positions and play guitar sounds when the user forms different chord. It lets users experiment with making music without holding a physical guitar.

How we built it:

We built a web app using HTML, CSS, and JavaScript. We used MediaPipe to track hand movements through the webcam and connected the detected positions to guitar sounds.

Challenges we ran into:

It was challenging to make hand tracking consistent and reduce the delay between a movement and the sound playing.

Accomplishments that we’re proud of:

We created a working prototype that uses hand tracking to play guitar sounds. We’re proud to explore a new way for people to interact with music.

What we learned:

We learned how to use real-time hand tracking and connect it to audio in a web app. We also learned how important responsiveness and reliable tracking are to the user experience.

What’s next for your Project:

We’d like to improve tracking accuracy, add more chords and sounds, and make the controls adjustable for different users. In future versions, we would like to make a full control guitar.

AI TRANSPARENCY: USED AI FOR DEBUGGING AND LEARNING CONCEPTS ONLY.

Built With

Share this project:

Updates

Submission history