Visual Med

easiness for doctors = health for everyone

Comment

Inspiration

For medical cases, people need to have a group review over everyone's work everyday in the morning. That usually has more than 100 cases via a stack of medical images a day. It is time consuming and everyone has to be on-site. So, we come up an idea to show images in 3d. Furthermore, we want to create something fun for students while learning. Proof of concept for medicine.

What it does

It loads the medical images and turns them into 3d-alike look in Hololens. With interactions, they are able to manipulate the 'model' to right angle or slice for better look. We build a little game for medical education purpose where students are asked to manipulate specific parts of a 3d model to re-assemble it.

How we built it

We built it using Unity and Hololens: add interaction(gestures) to control the image/model in Hololens

Challenges we ran into

  1. Hololens API integration with some interactions we want
  2. Precision of gestures
  3. Imaging
  4. Performance ## Accomplishments that we're proud of
  5. we actually pull that off
  6. results are good enough for two days work ## What we learned
  7. More possible ways to develop for Hololens AR application
  8. Imaging
  9. Solve performance issue ## What's next for Med for Med: AR Medical Application
  10. add remote session
  11. Dynamical loading from external drive ## Credits All the medical images/models are from UMass Medical Hololens API Some control codes along with medical assets
Share this project:

Updates