DoHub

Inspiration

iPhone Duo's new form factor brought a unique opportunity to create a device that truly lives as your hub. DoHub is a hub for your favorite shortcuts and music, all hands free thanks to computer vision. Hold up a gesture to trigger a shortcut, or become your own hands-free DJ.

What it does

Combining Shortcuts and Music allows DoHub to become a central hub for any sort of user. It adapts to their lifestyle and supports any sort of shortcuts. In Music Mode, users can separate stems from songs, and truly mix up their favorite music. Best of all, all of this control can be done hands free, by simply doing some gestures on iPhone duo.

How we built it

We combined Swift UI, Apple Vision, AV Foundation, Siri Shortcuts, and more to allow for all actions to take place. Vision handles the hand gestures and translation, within the shortcut mode of the app, users can hold up a pre-defined gesture with their hand. Within the Music experience, users can pinch and drag stems in the air, and DJ their favorite songs.

Challenges we ran into

We ran into issues with getting tracking right as well as using the simulator since we can't use the camera in it.

Accomplishments that we're proud of

We were able to combine all these powerful technologies in a really short time, and it's super fun to use!

What we learned

The iPhone Duo form factor is very unique, working with the new adaptable container proved its own challenges, but we're glad to build something that runs across multiple device classes.