Inspiration

On my last long-haul flight, I didn’t have a good time. Tiny seat, got bored of reading, got bored of movies. The feeling of being stuck there and just wondering about all the things in the busy world going on around me made me wish I could see through the fuselage - gaze at the stars, see who else is in the sky, just be part of this amazing experience of flying through the air!

What it does

By gathering both offline and online data, this app extends your reality by both showing you the world outside the aircraft, and by also showing you objects above, and other aircraft beside and below you. By making use of the Quest 3’s pass through and travel mode depth mapping, you can choose where you want YOUR window. A full “glass fuselage”immersive mode is also available.

How I built it

Coffee, Unity and a bit of ChatGPT. A lot of research was also required into available APIs and datasets.

Challenges I ran into

As my first XR app, it was a significant challenge. The first challenge was how to structure the menus and interaction logic for a smooth and immersive user experience in a cramped environment where you can't use your arms much. Another is providing a stable MR experience without the scene graph when in travel mode. Finally, the app uses a lot of data so multi-threading was required to not impact performance too much.

Accomplishments that I’m proud of

The overall effect of using the app in a real airplane is quite pleasing! Also getting the sheer amount of data visualized is quite satisfying.

What we learned

The Meta SDK is very powerful and easy to use. Also, even a non turbulent environment makes manipulation a little tricky.

What's next for MyFlight XR

Public release. Also, since paid APIs are required, a subscription will be necessary.

Built With

  • c#
  • cesium
  • passthrough
  • quest
  • travelmode
  • unity
Share this project:

Updates