Inspiration
14 years ago Ka'i started a 30 year mission to work on the Final Camera. World splats are a stepping stone toward a camera system and content type that can't be improved upon.
What it does
A world splat camera for virtual world enjoyers
How we built it
Equirect capture in threejs prototype -> World Labs generation. Demo pipeline all contained in one app, BYOK.
Challenges we ran into
Injecting cameras into threejs is especially tricky without Tampermonkey, which hinders adoption in threejs.
What we learned
Splats in this pipeline can actually be sort of like compression. Lossy. This was unintuitive to me based on prior experience with splats running poorly on standalone VR devices.
Quality of World Labs generations degrades if there are less detail markers in the scene. Makes sense, as this is also an issue with SLAM in general.
What's next for Splatshots
I have 20TB of 360 panoramas captured mostly in virtual worlds that could be used to train models.
Built With
- indexeddb
- three.js
Log in or sign up for Devpost to join the conversation.