TV remotes are ubiquitous. Even more than smartphones, they live in all of our homes, but have largely been abandoned due to the advent of Wifi and Bluetooth.
We challenged ourselves to build a hardware hack that anyone would be able use at home using just off-the-shelf parts and without tinkering experience. Bringing TV remotes into the 21st century fit that goal perfectly.
What it does
Control anything on your laptop by pointing a TV remote at it!
Our app translates gestures into common actions. These actions are context-aware and specific to whatever app you're using. We've added support for many common apps, but extending this to your favorite app takes just seconds using our configuration system.
How we built it
We took advantage of the fact that laptop webcams can detect infrared (IR) light in addition to the visible light spectrum. We use OpenCV to identify the IR light coming from TV remotes and apply gesture recognition to this data to turn movements into human-understandable gestures.