As we were hacking, we realized that it was difficult to show research between hackers, even if they were sitting right next to eachother. We built a way to overcome this barrier: Screenflo. Screenflo is a service that allows windows and sessions to port from one device to another. We used a Myo to monitor hand gesture and arm movements, allowing a user to easily share whatever they are doing across computers and smartphones. We also added additional functionalities, including printing documents and uploading files to the cloud using Dropbox.
In our demo, a user takes a Facebook Messenger session from his phone and brings it to his computer. He then browses stack overflow and takes that session with a swipe to another computer. He then creates a new FPVlab forum session on that computer and brings it back to his own computer.
This app required a high level of integration across many devices. We used a Myo, a native Andorid app, a central server, a server on each user computer, and a chrome extension on each user computer's browser. This made for a lot of communication bugs and complexity.
Complete Program Flow Each movement would be registered by the Myo. The data would then be sent to our Android app, which send data (including hand pose and where the user was pointing) to a central server. The central server decided which computer to send data or requests to. The data or request for data was sent to the user's computer. If the Myo/Android app registered a grab from computer 1, the central server would send a reques to coumputer 1. The computer server would find its current tab URL with the chrome extension and send it back to the central server. When the Myo registered an opening of the hand toward computer 2, the tab URL would be sent from the central server to the server on computer 2, which would open a new tab of google chrome and open the URL there.