Pear'dev Aircraft Assessment App

Introducing our Aircraft Assessment App (TripleA)
A new immersive MR experience for aircraft maintenance training and assessment
Make your own scenarios come to life with 3D models of fighter jets and environments
Make voice memos intuitively with our speech-to-text feature

Inspiration

Aircraft Maintenance Assessments are typically conducted on training jets or during on-the-job training for servicemen. Training jets are unable to reflect a large variety of possible scenarios that servicemen may face when deployed, and on-the-job training requires many different operations, including installing and removing panels which must be meticulously documented for traceability. These processes are time-consuming and require significant time from servicemen, trainers, and the operating team. To familiarise servicemen further with the various scenarios and operations, we aim to build an immersive experiential environment which could be used for learning, practice and self-service assessments.

What it Does

By leveraging the high image quality and mixed reality capabilities of the Apple Vision Pro, our app enables traditional aircraft assessments to be done in a virtual space. This ensures that the quality of assessments remain high while significantly reducing the time and logistical effort required to arrange and conduct these assessments.

How We Built It

We developed this program using Swift via Xcode, capitalizing on the robust capabilities of the Apple ecosystem.

Challenges We Ran Into

Development on the Unity editor for Apple Vision Pro is costly due to constraints within the Unity and Apple ecosystems. Therefore, we transitioned our development to Xcode together with Reality Composer Pro, which provided a more cost-effective and efficient solution.

Accomplishments That We're Proud Of

Successfully transitioning development to Xcode and overcoming the technical challenges involved.
Creating a high-quality MR environment that simulates two aircraft conditions.
Enabling a Speech-to-Text feature, which utilizes Apple's SpeechRecognizer.

What We Learned

In-depth understanding of mixed reality development within the Apple ecosystem.

What's Next for Aircraft Assessment App (TripleA)

We aim to source and create more detailed and realistic images to enhance the fidelity of our virtual aircraft models. This will create an even more authentic experience, closely mirroring the real aircraft that servicemen work on. Additionally, we plan to expand the app's capabilities to include more comprehensive training scenarios and interactive features.