I was developing an AR app which helps mechanics during the maintenance process with animations and I was trying to add a virtual assistance feature so that they can get a help from someone expert.

What it does

The sample app renders a 3D engine model in AR and video chat object (plane), the app can help mechanics to learn about an instrument with the help of virtual assistance so that they can perform task easily. we are using The OpenTok Playground for using the video chat feature.

How we built it

It is made in ARKit in Xcode and uses ToKBox API for video chat features.

Challenges we ran into

Was trying to use it with Unity and IOS as unity as more interactive 3D interface compared to SceneKit but later moved to Xcode and IOS.

What we learned

integrating SceneKit and TokBox API with the help of the sample project here

What's next for Virtual Help

It will be great if we can create a Unity 3D plugin of ToKBox API so that it can be easily integrated into more AR apps and cross-platform.

Built With

Share this project: