Hologram Calls with Looking Glass

Inspiration

Two way holographic communication can help bring people closer together. It can also help create better outcomes for patients. With telemedicine now widely embraced, its crucial to have the most immersive, engaging, and informative visit possible. By showing 3D models of health related visual aides, doctors can make remote visits much more valuable.

What it does

This very simple MVP lets two or more people communicate using their depth sensing camera or webcam, mic, and looking glass holographic portraits. There is also a broadcast app that lets you have a conference call or video hang without the use of a looking glass device.

How we built it

Using a version of holoplay.js and dolby.io, we were able to map the live video stream and audio to 3D video textures in the Looking Glass Portrait for free floating holographic interaction. The secondary desktop app was built on visual studio and deployed with netlify.

Challenges we ran into

Three.js was new for me and I needed a lot of help working with git. I also had some trouble with the holoplay.js build as it was a limited demo.

Accomplishments that we're proud of

Happy to say that we got video and audio through! It was a challenge to get our build where we wanted it but thanks to the dolby team, we got plenty of support.

What we learned

Be patient and go for small wins to lead into bigger feature implementations.

What's next for Looking Glass Dolby MVP

For the desktop app as well as the hologram app, it would be great to test with different health professionals and improve the size and capture of the person speaking. It will also be exciting to continue exploring avatar conversations. With so much excitement around NFTs, it might also be fun to use profile pic avatars as masks.

Built With

• lookingglass
• three.js
• visual-studio