There was so much cool hardware to hack with, that we wanted to try all of it! This project combines the Oculus, Roomba, and Kinect into what we think is a really fun experience. Also Google DeepDream is wild.

What it does

Use an Xbox One controller to drive around a Roomba. A Kinect is strapped to the Roomba and streams point clouds to DeepDream. The Kinect point cloud is passed through several iterations of DeepDream, leading to a psychedelic effect, before being sent to your Oculus VR.

How we built it

Most robot interconnectivity is handled by ROS (Roomba, Oculus, Kinect). DeepDream runs on our CUDA-enabled laptop.

Challenges we ran into

Installer CUDA Installing Oculus SDK Connecting Kinect to Oculus with Rviz

Accomplishments that we're proud of

Getting everything installed in 12 hours.

What we learned

Mostly how to install software toolkits.

What's next for Nightmare Goggles


Built With

Share this project: