We used the camera of an iPhone to turn our computers into touch screens using computer vision. Our initial prototype supports moving the cursor and clicking. Our backend supports more complex gestures such as scrolling and keyboard shortcuts but the app is not precise enough yet to use these features (we are still working on fully reducing noise/glare in the video stream in real time).

Built With

Share this project: