Inspiration
Amplium makes immersive films, shot in stereo 180° on a cinema camera built for immersive video. These films hold far more detail than a headset can decode. Meta VR Glasses will have a 37 pixels-per-degree display, but Meta headsets share an 8K60 decode limit, so a plain 180° frame cannot fill that display. We wanted films that are sharp where you look, in a library you use with nothing but your hands.
What it does
Amplium is a lean-back library of immersive films for Meta Quest. Browse the Home window, open a title and press Watch. The film surrounds you; a thumb tap pauses, a thumb swipe seeks, and a small player bar appears when you need it. Films stream, or download to play offline. Everything works seated, without controllers.
The competition build has three films from our partner studios, shown with their permission: The Longest Day, KICK and Echoes of the Middle East.
How we built it
- Static foveation: before encoding, every frame is warped so the center of each eye gets up to 1.88× the pixel density and the far edges get less. At 3072 px per eye this gives about 32 pixels per degree at the center; a plain frame of the same size gives about 17.
- Player (Unity 6, Meta XR SDK v207): side-by-side 10-bit HEVC, 6144 × 3072 at 90 fps, drawn on a calibration mesh for each eye. The un-warp lives in the mesh UVs, so the shader is a simple texture lookup and the viewer never sees the warp. A small native HLS reader hands decoded frames to the GPU.
- Encode: our pipeline turns the camera's fisheye frames into a static-foveated master, then a 10-bit software encode spends more bits on the center of each eye. Measured against the master, the 80 Mbps stream keeps a VMAF of about 95.
- Hands: Meta Interaction SDK for ray and poke, and thumb microgestures during playback.
- Testing without a headset: playback, navigation, gestures and variant choice live in pure C# with unit tests. Python tools render what each eye sees and compare every clip with an un-foveated reference.
Challenges
On Quest, apps receive only one view of an MV-HEVC stream, so both eyes travel side by side in one frame. At 6144 × 3072 and 90 fps the player runs close to the decoder's limit: we had to find and fix decoder memory that was not released between films, and white flashes in HLS playback.
What we learned
Where the pixels go matters more than how many there are. The same decode budget looks nearly twice as sharp when the pixels sit where people look.
What's next
- A Meta VR Glasses tier: filling a 37 PPD display needs about 6,660 px per eye with a plain frame, but about 3,540 with static foveation, which fits the decoder.
- HDR, spatial audio and DRM.
- More films from more studios.
