Inspiration
Love of music and epic music.
What it does
A conductor stands in front of the Seeed Studio XIAO ESP32-S3 + 3D ToF sensor (mounted on a music stand). Instead of holding a passive wooden baton or needing wearable motion-capture gloves, mid-air 3D hand coordinates $(x, y, z)$ and velocity vectors control a virtual orchestra in real time—while discrete static/dynamic hand signs trigger spoken rehearsal cues to specific sections ("Strings, softer," "Brass, hold," "Take it from measure 12") for accessible, silent, or remote ensemble direction.
How we built it
Challenges we ran into
Accomplishments that we're proud of
What we learned
What's next for Hermes Baton — 3D Touchless Orchestra Conductor
Built With
- camera
- esp32
- sensor
- tof
- vl53l8cx
- xiao
