AirTouch

Project Description

Project Title: AirTouch: Touch-Free Gesture Control for Your Computer

Inspiration
In a world moving toward more natural human-computer interaction, traditional input devices like mouse and keyboard can feel limiting — especially for people with disabilities, in touch-free environments (e.g., kitchens, workshops, medical settings), or during presentations. I wanted to turn any regular laptop or desktop webcam into a powerful gesture-based controller, essentially transforming the space in front of your screen into a virtual touchscreen.

What It Does
AirTouch enables real-time, touch-free control of your computer using simple, intuitive hand gestures:

Cursor Control — Move your index finger to control the mouse cursor smoothly.
Left Click — Pinch thumb + middle finger.
Right Click — Pinch thumb + ring finger.
Screenshot — Form a fist.
Scroll — Move index + middle finger together up or down.
Drawing Mode — Use index finger to draw directly on the screen.

The system works in real-time with just a standard webcam, making it accessible and hardware-light.

How We Built It
I developed AirTouch in Python using:

MediaPipe — for accurate, real-time hand landmark detection
OpenCV — for camera feed processing and visual feedback
PyAutoGUI — for OS-level mouse and keyboard automation

Gesture recognition is based on precise landmark distance calculations and dynamic thresholds, carefully tuned for reliability across different lighting conditions and hand orientations.

Challenges We Ran Into
One major challenge was gesture conflict resolution — the index finger was responsible for both cursor movement and drawing mode. I had to implement a clean state management system with visual indicators to prevent accidental triggers and ensure smooth transitions between modes. Tuning thresholds for reliable detection without false positives was also technically demanding.

Accomplishments That We're Proud Of
Successfully built a fully working MVP that can reliably control a computer using only hand gestures. The system runs in real-time with good accuracy, and the drawing feature provides an immediate, satisfying "wow" experience that demonstrates the project's potential.

What We Learned
This project gave me hands-on experience in computer vision, real-time systems, and bridging AI models with operating system controls. I gained deep appreciation for the importance of robust threshold tuning, state management in gesture systems, and designing intuitive interactions that feel natural to users.

What's Next for AirTouch