Inspiration

After two years debating with flat earthers, and being frustrated by the lack of freedom in many existing solar system simulators, I came to the conclusion that I had to build a more fine tuned tool to help me illustrate with more precision celestial events. From here I started to add more details, this is still ongoing... and so this is The real solar system, at true scale, on a standalone Meta Quest 3, flown with nothing but your hands.

Hold your right hand flat and you are flying: from beyond Pluto down to a crater floor on the Moon. One rule: stay as close to reality as possible. Planets stand where NASA's ephemeris puts them, the ground comes from measured elevation, each sky from its world's own air. Inside Jupiter, thunder reaches you half a minute after a flash 30 km away, because that is the speed of sound in hydrogen.

What it does

  • Free flight. This applications allows to fly anywhere in the Solar System, from space to the surface of planets.
  • True scale, true positions. The Sun, 8 planets, Ceres, Pluto and 16 moons; planets and Moon placed by NASA JPL's DE440 ephemeris, from 1990 to 2150. The simulated solar eclipse of 12 August 2026 peaks within one second of NASA's time.
  • Real ground. Measured elevation (NASA's LOLA for the Moon and MOLA for Mars, streamed tiles down to 38 m for the Earth), with procedural detail down to 25 cm. Land, and your room's floor is the ground, to the centimeter.
  • Skies from physics. Scattering for each atmosphere; refraction traced through the standard atmosphere (a flattened setting Sun, mirages, the green flash); an eclipsed Moon colored by sunlight the Earth's air bends into its shadow.
  • Jupiter and Saturn from the inside. Fly down through volumetric cloud decks and storm towers lit by lightning.
  • The invisible, shown. Magnetic field lines from published models, auroras from the Earth to Neptune (the Earth's follow NOAA's live data), and the radio waves spacecraft recorded around the planets, re-created as spatial sound.
  • Hands only. A flat hand flies; an open left hand runs time both ways; two hands framing a planet make a telescope whose view you can keep as a live panel; palms brought together shrink the system into a model in your real room.
  • Place virtual points of view anywhere. You can add observation points in space and time to watch events from multiple angles at the same time.
  • Pick a date and observe eclipses Easily moving back and forth in time to watch events at different paces, with a simple hand gesture.

How I built it

I built it with an AI coding agent, Claude Code, across some 200 logged sessions in under seven weeks. I set the goals (methods, algorithms, quality, points to focus on, technics to test), wear the headset and report what I see; the agent writes most of the code, measures and documents.

The method: settings are code, so one script configures the project and generates the scene. The simulation core is plain C# in double precision, and 235 automated tests guard the project, some against NASA's eclipse data. Performance is measured on the headset: pinned GPU clocks, Perfetto traces, RenderDoc captures. Everything is written down: a change log, my decisions, a document per module and 79 reports at the time this description is written.

Challenges we ran into

A solar system does not fit in a float. The simulation runs in double precision, the headset stays at the origin while the universe moves around it, and the ground uses logarithmic depth. Even so, in the telescope Neptune was a brown square, lost in rounding. Each narrow view now lays the universe out along its own axis, and Pluto and Charon separate cleanly.

Clouds kilometers high on a mobile chip. At full resolution each sample along a ray cost about 1 ms a frame, and a cloud needs dozens. Three weeks and several discarded renderers later, the clouds are baked into nested grids around the viewer and marched once for both eyes, one texel in 64 per frame (more along outlines) with the rest reused, while Application SpaceWarp turns 36 rendered frames into 72. At my test spots the GPU takes 18 to 21 ms a frame. Fast-moving outlines still need polish.

The headset disagrees with the desk. Auroras perfect in the editor were missing on the Quest: its shader compiler silently discarded the results of branches nested deep in a loop, and nine builds were timed "at 72 fps" with their curtains gone. Clouds beyond 65 km turned coarse: the Quest read a texture at half precision and a distance in meters overflowed. Shader decisions painted as colors in the headset found both; flatter code and a full-precision texture cured them. The rule since: look first, time after.

Hands are not buttons. The tracker guesses fingers it cannot see, so my pointing gesture took many tries, and the app's own log showed a folded shelf of saved views claiming my hand 95 % of the time. Flight now starts from a flat hand held still.

Accomplishments that we're proud of

  • An eclipse within one second of NASA's prediction, in a simulation you can stand inside.
  • From interplanetary space to a landscape underfoot in one flight, at 72 frames a second at my test points on Earth, Moon and Mars.
  • Volumetric storms with lightning and thunder on a standalone headset.
  • Physics down to the small things: mirages, the green flash, auroras shaped by real field models, planets you can hear, the atmospheric refraction on earth, the shadows on rocky bodies, the volumetric clouds on gas giants..
  • The telescope view
  • The overall mood and freedom when flying over planets surfaces.

What's next for VR Solar System

Introducing more celestial bodies, improving visual quality and details, adding predefined famous point of views (for example, where and when the Blue Marble from 1972 was taken), adding human structures in space and maybe on earth surface (this last one is not sure yet). A better AR view, to display the whole system as a model at human scale.

Built With

Share this project:

Updates

Submission history