Inspiration
What would Star Wars be with only 2D Skype video talks? Without the beloved holograms? You got it. Nothing! This is why we want to bring 3D communication to our 2D stuck earth.
What it does
3D face projection for a futuristic communication model.
How we built it
We use an industry camera to capture live images. Before displaying the images on a screen they have to be manipulated in multiple ways.
To strengthen the optical illusion of the 3D effect, one has to identify foreground and background using a green screen to color the background in a pure black.
Second, the image has to be placed four times with different rotations.
Challenges we ran into
To setup the development environment (including the set up of OpenCV) took ways longer than expected. So, we tried to develop a face segmentation algorithm manually, first. Furthermore, we had problems with the lightning of our test objects, which made the segmentation harder.
Accomplishments that we're proud of
Building up a great team!
What we learned
To setup a development environment for OpenCV upfront and how to create art with gradient filters while not being able to solve our basic exercises - wait for it ;-)
What's next for #hanholo
Using four cameras in different positions (front, back, left and right) to create an all-round view of a head in the hologram. We also thought of using AI for background recognition and removal to make the use of our green screen unnecessary. To make communication more fun we could create some fancy filters. An exercise for the hidden engineers in us: creating a portable hologram!
Log in or sign up for Devpost to join the conversation.