Crisis scenarios are plagued with confusion, misinformation, and fear. In the wake of the Parkland shooting, officers explained that information was wildly unreliable causing indecision and slow reaction. as a As a result, the devastating effects of the shooters rampage could have been mitigated if information was much more reliable. Additionally, victims of the incident were left in the dark, unsure of their fate as the incident continued.
There were hiccups in the process that surely could have been avoided. We used this hackathon as an opportunity to solve those problems with community sourcing and the Hololens, a handsfree augmented reality device.
After researching the pain points of both first responders and victims, we understood that the problem was two-fold.
(1) First responders are encumbered with unreliable information. They can’t accurately sort fact from fiction to act decisively.
(2) Victims are left in the dark. They don’t have the tools to relay information to responders without giving themselves away to the shooter. The problem ultimately boiled down to quick, reliable information on all fronts. People in the system don't have the time to sort through the right information. They need to act instead of think. Emergency AR removes those barriers.
What it does
Emergency AR leverages the power of augmented reality meshing and real-time data sourcing from the community to quickly locate threats.This allows first responders wearing the Hololens to quickly locate the threat while simultaneously being aware of victim locations, thus eliminating false positives of the location of the shooter. Additionally, victim's phones are used as beacons of information by streaming their auditory and location information to the first responder's Hololens HUD. Finally, victims are given a sense of security through the app which gives live updates based on responders movement and updates to the system.
How we built it
We leveraged mobile phones and Hololens in a shared environment.
Challenges we ran encountered
Having to debug in 3D space. We were unable to console log Hololens into Visual studio. Debugging through the Hololens was a slow process because we had to deploy the project anytime we had to test. Getting mobile phones and the Hololens to sync with each other. Communicating between two different devices is really really hard. We were overly ambitious and not lean enough in creating our project.
What we learned
We learned how to create a shared scene across different devices using a web socket hosted on heroku. Even though it didn't work, we learned the process of using it.
What's next for this Emergency AR
We want to continue to build Emergency AR to be able to handle different crises beyond active shooter scenarios such as natural disasters, bomb threats, or evacuations. In order to do so, we will need a better understanding of