Time Heist

Inspiration

What if you can teleport 3D holographic objects from video?

What it does

Inspiration

What if you can time travel... by teleporting 3D objects from video?

Effectively, you can eyedropper from reality - similar to Photoshop, but in full 3D.

We use twelve labs to easily search through our videos to find suitable frames to use for our bleeding edge image to 3D AI.

Here we have video youtube footage of a priceless heirloom

Here we recognize select objects. We tap to load the rough and quick generated AI 3D model. DreamGaussian

It's as easy as eyedropper in Photoshop - but you are sampling from reality. Photoshopping what if you can "RealityShop"

Note that this is a full 3D mesh.

We then tap again to approve a more detailed 3D mesh generation. Here we have taken the liberty to use videogrammetry.

Note that this is also a full 3D mesh

We use eleven labs for our interface status text to speech audio.

We want to emphasize this is way beyond just creating digital assets.

This generated 3D model has huge implication. Effectively, this enables anyone to be a product designer - without needing to spend years learning how to use 3D creation software.

Once upon a time we used to live in a world where we created and bought locally from master artisans.
Conclusion 2

What you saw here is a hack from scratch that we started about 18 hours ago. Not shown are the next steps - the user can modify and extend from reality.

My bootstrapped startup is building that spatial computing software that allows humans to create 3D at the speed of ideas. So that everyone can reach their creator potential.

https://www.youtube.com/watch?v=AoAwfL1-TSQ

How we built it

React app calls Twelve Labs API to search videos and find the clip containing the object. Then the React app extracts key frames from the video clip, segments out the background, and generates a 3D model and texture.

Unity iOS Android Vision Pro app provides the intuitive 0-learning curve app for 3D AR. Shot live from app running on my iPhone