During these sensitive times, we need to maintain social distancing. However, there are times when we cannot do that, For example, An important machine breaks down in a hospital, the engineer who will come down to solve the problem and hence will be extremely vulnerable due to the hospital environment. Hence we aimed to build a solution where an engineer can remotely help even less skilled people in fixing that machine by providing AR based remote instructions step by step.
What it does
It provides an AR-based annotations lobby where two people can connect.One can point their camera to the region of the problem and the other can remotely guide them how to solve it without actually being there.They can guide them by means of 3D models,drawings and steps.
How I built it
Built it on UNITY3d for the game environment and Photon/Agora.io for network.
Challenges I ran into
It was a challenge to implement and integrate screensharing. We found a workaround but we aim to optimize this
Accomplishments that I'm proud of
Providing jitter proof AR experience
What I learned
A lot about how lobbies work and how video camera feed can be fiddled around with
What's next for Remote Machine Repair Assistance
Optimization and more tools.