For HackTX, our team built a webcam-based teleoperation system that allows a robot to mimic a user's arm movements in real time!

Using computer vision, we tracked the user's arm positions through a standard webcam and translated those movements into commands for the robot's arms. The goal was to make controlling a robot as intuitive as possible, without needing specialized motion-tracking hardware or VR controllers.

It was a fun opportunity to combine computer vision, robotics, and real-time control into a working prototype over a single hackathon weekend!

Built With

  • mediapipe
  • python
  • rasberrypi
  • robotics
  • tailscale
Share this project:

Updates

Submission history