DSI MediMR

MediMR is Mixed Reality application for Medicine

Comment 2

Inspiration - Virtual reality (VR) and augmented reality (AR) can provide great tools for doctors to better diagnose a medical issue and be better prepared for surgeries. They can also provide improved patient consultation and calm patient nerves by showcasing the anomaly. DSI MediMR is a step in building such a mixed reality application for medicine.

What it does

DSI MediMR is a mixed reality environment that includes a virtual reality environment to help doctors to view medical scans like CT, MRI scans, visualize anatomical parts, immerse within them to understand anomalies, take notes for surgery preparation etc. DSI MediMR also includes an augmented reality environment which is used by the surgeon for better patient consultation. The AR environment is also useful for surgery preparation.

Challenges we ran into

We ran into number of challenges as part of building DSI MediMR. These challenges included

  1. Finding the right set of medical images for the virtual reality environment to be displayed on the surgeon screen
  2. Building the right virtual reality environment for the surgeon to diagnose the patient
  3. Making sure all the pieces - calls to FiHR specification, the virtual reality environment, the augmented reality environment, work smoothly to make MediMR a great product.

Accomplishments that we are proud of

The MediMR team did a fantastic job in building the application in less than 24 hours. There are a lot of things the team is really proud of this includes putting our heads together for the great idea, working tirelessly through the event, getting a good set of CT scans to use, how we can extensively use of FiHR specification for patient history information including storing CT scans, surgeon notes etc. Last but not the least making sure all the different pieces work together well so that we can showcase an awesome product and presentation

What's next for DSI MediMR

DSI MediMR is just the beginning of mixed reality application for medicine, with better scans/images the virtual environment can be enhanced further. Extending this for surgical training, treatment for PTSD, rehabilitation etc. are some of the obvious next steps for mixed reality application in medicine.

Share this project:

Updates