IncisionVR

Inspiration

Entering Hacklytics, my team and I entered this hackathon with no prior experience in a hackathon before. We are a team that just started getting into CS this semester as 3 of us are in CS 1331 taking our first major CS course. We started having no idea of what to do for this hackathon until we entered our first Hackytics workshop with GTXR. Through this workshop, we realized the importance of virtual reality and wanted to use VR in our project for Hacklytics.

What it does

We thought about how simulations have helped many industries with their training, like aviation training with pilots or natural disaster training for first responders, and wanted to tie that into one of the tracks Hacklytics has. We decided to take our shot with the healthcare track and create a simulation for training to be medical professionals. After much discussion, we have decided to create a VR simulation for medical physicians who are training, to learn how to properly and accurately make an incision on a patient for a particular surgery. In this beta demo of our program, we made a surgical incision that would be an example of an “ideal” surgical incision and compared that ideal result with the user's incision in the program.

How we built it

There were many things that we learned during this project and the major one was learning C# in the span of 3 days and incorporating it into Unity. Unity is the game engine that we choose to build the project on. Unity definitely took some time to get the hang of it and but eventually got a hang of it at the end. We learned about importing assets and coding their functionality. We additionally had to learn to create the environment(surgical room) and code the accuracy of the cuts.

Challenges we ran into

We faced many challenges creating this project as we are all new to Unity but a major challenge that we faced was how to measure the accuracy of the incision that the users make. We decided to create the “ideal” incision which is the proper incision that the surgical professional would make and decided to create an average of proper cuts and compare that with the incisions that the users make. We had to learn about vectors and how to code that into a function in order to make those comparisons.

Accomplishments that we're proud of

Accomplishments we are proud of is learning everything in a short period of time and actually creating a project out of it. It was fun to also work with MetaQuest2.

What we learned

We learned how to use Unity and code with C#.

What's next for IncisionVR

The next step for IncisionVR is using more accurate surgical data and expanding the simulation to be focused on specific body parts like the brain and the chest.

Built With

• c#
• metaquest
• oculus
• oculus-gear-vr
• python
• unity
• vr