AuraLink-Exo

veiw this https://youtube.com/shorts/EKWq01mYiQI?feature=share discord user: theoneorbit_93049 Inspiration

Traditional human-computer interaction relies heavily on clunky physical peripherals like wired mice and keyboards. We wanted to build something that felt like the future—a touchless, completely wireless air-mouse interface. AuraLink was born out of the desire to turn natural, fluid hand gestures into fast operating system controls while streaming that state data straight to an external hardware display. What it does

AuraLink transforms your hand into a wireless controller by mapping your index finger to smooth mouse movement on your PC monitor. Making a fist inputs a standard left click, an open hand triggers a right click, and raising two or three fingers controls media playback and toggles system muting. Simultaneously, the system broadcasts the active gesture data over Wi-Fi to dynamically update a physical, external LCD panel. How we built it

The system uses an optimized vision pipeline on Ubuntu Linux powered by OpenCV and MediaPipe to track hand joints. This Python script maps your index finger to smooth cursor tracking while processing clicks, media play/pause, and master audio muting. The gesture data is then sent over local Wi-Fi to an ESP8266 NodeMCU web server, which forwards the packets via serial communication to an Arduino Uno and a 16x2 LCD screen. Challenges we ran into

Our biggest hurdle was dealing with a display screen that initially printed scrambled, alien-looking gibberish symbols instead of clear words. We discovered this was caused by a missing common ground wire between the two microcontrollers, which allowed electrical noise to distort the signals. Additionally, we had to build a background thread with a strict 2-second action cooldown to prevent fast camera frames from spamming and locking up the OS. Accomplishments that we're proud of

We are incredibly proud of building a working, lag-free bridge between high-level computer vision software and low-level embedded hardware. Writing custom multi-threaded Python scripts that prevent network latency from freezing the camera feed was a massive technical victory for us. Seeing the LCD screen snap to life wirelessly the exact millisecond a hand gesture changes felt like magic after hours of troubleshooting. What we learned

We learned that software-driven serial ports on microcontrollers become highly unstable and lose data when pushed to high speeds like 115200 baud. Dropping the communication down to a stable 9600 baud fixed the data corruption and kept the wireless pipeline working perfectly. We also learned how to use Euclidean distance math to accurately track the thumb regardless of which hand is used or mirrored by the camera view. What's next for AuraLink-Exo

The next step is adding machine learning models to expand the vocabulary of gesture tracking beyond basic finger counts. We also plan to integrate the PCA9685 servo driver back into the hardware layer to convert these signals into real-time physical robotic arm movements. Eventually, we want to package the entire Python environment into a lightweight background application with a clean, graphical user interface.