What it does
Synthwave lets you control digital audio software by moving your hands within the view of a camera feed from a webcam or drone. It does this by using a computer vision model to detect your hands and convert visual signals into MIDI signals used by all major music software.
How we built it
- Hand detection: MediaPipe and OpenCV
- MIDI signal output: python-rtmidi
- DJI Tello drone integrations: DJITelloPy
Challenges we ran into
- Tello version did not support access to downward facing tof sensors and camera.
- Tello does not support GPS or equivalent.
Log in or sign up for Devpost to join the conversation.