Space Vitals: a Medical AR Platform

• 

  Concept Diagram

Inspiration

Future of space-life needs to be equitable for humans with medical conditions (unlike trained astronauts, who are vetted and in optimal health condition). Also, there is a scarcity of medical specialists and they cannot be available in every location in space. So, our vision is to provide Access to personal medical specialist, 24x7, anywhere in the space

What it does

Wearables (eg: Apple Watch) allow on-demand body vitals. AR/MR devices (eg: HoloLens) enable rules-based tracking of specific pre-programmed objects (eg: sensors, humans, devices etc). So, we are creating a white-label Medical AR platform to design integrations with medical devices and customized workflows. The end-result will be a hologram screen that will track specific medical object/human and display body-vitals and medical conditions, in real-time. Use-Case: Imagine a group of 10 people in space. Our custom AR/MR headset can be worn by one human amongst them and monitor others in their group and can act as a "medical lens" through which data is analyzed and relayed to a medical expert in a remote location. Presentation https://docs.google.com/presentation/d/1Fjv7iNv84vJzlFcIXJl5Ifw1duo_EvCR/edit?usp=sharing&ouid=107724524894769714344&rtpof=true&sd=true

How we built it

We built a simple proof-of-concept in Unity to simulate the tracking of human face and display a hologram-screen as the face is tracked. We also built a program to track a pre-defined image-patch (aka sensor or wearable) and then track the human wearing that image-patch, but if the patch is removed, it stops tracking. The results indicate that, custom workflows can be built to track specific defined-objects and then integrate it with the AR headset.

Challenges we ran into

We wanted to integrate multiple device cameras into the Unity portal and show how it can track via 2 separate smart-phone cameras and display individual holo-screen for each tracker. Due to time constraints, we cold not get this demo to work.

Accomplishments that we're proud of

1. Developing a new concept and creating a presentation with demo in 24 hours
2. Increasing our understanding of AR and MR.

What we learned

1. YOLO tracker that can sense human heart-beat have existed for more than 3 years.
2. Technology is not a barrier. Understanding the problem and the specific-use case and then knowing how to apply the tech is the key.

What's next for Space Vitals

We will refine our proof-of-concept and test integration with real-life wearables.

Built With

• c#
• unity