Silver Unicorn is a collection of hacks and APIs that aims to serve as a prototyping platform for Augmented Reality by handling human-digital-physical interactions. The original project includes a hack for Microsoft Hololens that set up a complete loop of interactions between a human using voice to control a Sphero via a TCP server running on a Mac OS app. The Sphero was contained in a box with an image that was marked and recognized by the Vuforia engine running on Hololens, which then rendered a digital object for the user to interact with.
After not making it to semifinals the team continued hacking with the aim of moving an Arduino powered robot through the physical world using the tracking features in the HTC Vive Wand. A UDP network would then pass that information to Hololens which could project the movements of the robot in a digital rendering of the Vive's physical space. Unfortunately, networking with Unity is really hard.
This is where you can come in. We're really excited about the potential this type of technology gives us to redefine the relationships between physical and digital objects. We plan to continue these efforts and will expand the work we've done to continue building out usable APIs and hacks that integrate physical objects into virtual environments or give us new ways to interact with them through digital means.
The original project was built over the course of 67 hours at the Reality, Virtually, Hackathon! sponsored by the MIT Media Lab. Although all group members slept at some point, at no point since first convening on Saturday did all participants sleep at the same time. No robots were harmed in the making of this project, no matter what Erlich Bachman says.