Memories degrade with age. Knowledge is lost with time if not documented.
What it does
Tribal Knowledge allows you to capture, remember, and relive experiences that are important to you.
How we built it
Unity, Android Studio, xCode for prototyping and viewing the 3D assets in AR, GO and Postman to utilize the AutoForge API, Torch for quick AR prototyping.
Starting with our concept for capturing in AR and localizing 3D content to the real world to preserve our memories. We explored the Esri SDK along with Augmented Images with ARCore to pin memories to the real world and we realized VR would be a better medium for first access these experiences virtually.
While using the AutoDesk Forge API, ARKit and the Structure sensor. We were able to create complex 3D assets effortlessly via Mobile Devices.
Once our memories where digitally preserved. We began creating a virtual space to display these memories and interact with other users using Unity, HTC Vive headset and HP MR headset .
Challenges we ran into
Creating 3D captures from user input proved difficult. We found the most success using the Structure sensor, mixed results with the 20 image limit on Autodesk Forge ReCap, and fun but untextured captures via the Hololens.
Accomplishments that we're proud of
Capturing volumetric memories and revisiting them in VR, and sharing simultaneously in AR.
What we learned
The toolkit for creating VR and AR experience has evolved over the past past few years, but it has light years of ground to cover before we can experience and create localized applications that are contextual to the space we are in the needs of unique users.
What's next for Tribal Knowledge
Optimizing the usage of AutoDesk Forge API.
- Further our capture technology with object detection to separate the object of interest from the scene to quicken the upload speed and forge better models with less noise from the surrounding scene.