Tribal Knowledge

Problem Space
Evolution of comms. But capture?
Value Prop
System Map
User Flow
Proof of Use Case
Capture
Load Memory in VR - Production Version
Load Memory in VR -Play Testing
Load Memory in VR -Initial Prototype
Share in AR
Share in AR
Innovation Journey
Tribal Knowledge - A Tribe - A Team

Inspiration

Memories degrade with age. Knowledge is lost with time if not documented.

What it does

Tribal Knowledge allows you to capture, remember, and relive experiences that are important to you.

How we built it

Unity, Android Studio, xCode for prototyping and viewing the 3D assets in AR, GO and Postman to utilize the AutoForge API, Torch for quick AR prototyping.

Innovation Journey

Starting with our concept for capturing in AR and localizing 3D content to the real world to preserve our memories. We explored the Esri SDK along with Augmented Images with ARCore to pin memories to the real world and we realized VR would be a better medium for first access these experiences virtually.

While using the AutoDesk Forge API, ARKit and the Structure sensor. We were able to create complex 3D assets effortlessly via Mobile Devices.

Once our memories where digitally preserved. We began creating a virtual space to display these memories and interact with other users using Unity, HTC Vive headset and HP MR headset .

Challenges we ran into

Creating 3D captures from user input proved difficult. We found the most success using the Structure sensor, mixed results with the 20 image limit on Autodesk Forge ReCap, and fun but untextured captures via the Hololens.

Accomplishments that we're proud of

Capturing volumetric memories and revisiting them in VR, and sharing simultaneously in AR.

What we learned

The toolkit for creating VR and AR experience has evolved over the past past few years, but it has light years of ground to cover before we can experience and create localized applications that are contextual to the space we are in the needs of unique users.

What's next for Tribal Knowledge

Optimizing the usage of AutoDesk Forge API.

Further our capture technology with object detection to separate the object of interest from the scene to quicken the upload speed and forge better models with less noise from the surrounding scene.