With the ongoing COVID-19 pandemic, virtual connections took off into a next level, each day pushing into new technologies and requiring more and more dynamic reunions and different types of virtual experiences.
What it does
Our project seemlessly connects a virtual reality environment with an augmented reality experience in order to easily demonstrate any type of product, 3D model, idea, etc.!
How I built it
Using Unity, we created a VR application which works with any HMD. In this environment the user can interact with any of the imported assets in first person, being able to push, pull, throw, rotate and move around the VR environment! On the other hand, a mobile user can connect with an Android device using a separate Unity application and visualize the VR users actions in an AR environment for a very easy and real scale demonstration!
Challenges we ran into
The most challenging part of the project was connecting and properly synchronizing the VR scene with the AR environment, even with much research done in the internet, we couldn't find much information about combining these two technologies and therefore we had to work on it from our own knowledge and previous experience with Unity.
Accomplishments that we are proud of
We are very proud to have a working prototype of the AVR Experience, we can interact with many simple objects that can easily be imported into the VR application and then vizualize them in the AR environment.
What we learned
We learned a lot about the networking behind these type of projects, synchronizing objects and physical interactions between objects. But we also learned about making proper VR experiences and locomotion having to do with hand movement. We also learned how to create an AR project using Unity and it's packages.
What's next for AVR (Augmented Virtual Reality)
As shown in our demo, we want to work towards being able to interact with complex and dynamic 3D models, like robots, moving parts, mechanisms, etc. We got to a point where VR could interact with them but the AR view looks very funky and needs tweaking.