EMT+

An Augmented Reality tool to enable First Responders to react faster.

Comment

Inspiration

From the get go, when the Snapchat Spectacles were announced in the Slack channels, we wanted to build something cool using AR that would also have a community impact. Augmented Reality experiences opened a new dimension of connectivity and information that we used to create EMT+, a smart and functional interactive HUD that assists First Responders in emergency situations.

What it does

We created an unobtrusive yet informative Heads up Display for the Spectacles that interacts with an AI powered emergency call summarizer and predictive action recommender. For First Responders in the field, even a small delay due to communication could lead to life threatening consequences. Minimizing this delay by providing concise yet relevant information en route and while resolving situations is the motive for our project.

How we built it

The UI/UX design was done in Snapchat's AR experience designer, Lens Studio. The backend processing of emergency calls was written in Python, with transcription handled with Deepgram, text analysis through Gemini, file storage and retrieval in SingleStore, and system integration with Google Cloud.

Challenges we ran into

As first time hackers and first time AR developers, we entered this hackathon unsure of where to even begin. Setup issues with our Spectacles and the event internet was the first issue in a long line of debugging nightmares that followed, from learning how to interact with AR devices to setting up databases. Thankfully, workshops and great mentors were able to help us point in the right direction.

Accomplishments that we're proud of

Learning everything from UI/UX design to backend programming over two sleepless nights was quite the struggle. However, our best feat was probably the idea we devised within the first few hands-on hours with the Spectacles and the speed at which we brought ourselves up to speed. We're super proud of the project we made, the demonstrable potential impact our product brings, and the growth and experience we accomplished these past days.

What we learned

Momentum during a hackathon is definitely a real thing and super hard to claw back when lost, and taking constant breaks to refresh ourselves would be a good idea in the future!

What's next for EMT+

Unfortunately Snapchat is taking their Spectacles back, but this gives us a foundation for future work with AR and 3D environments. We look forward to exploring the possibilities of using computer vision, voice recognition, and AI inference tools to add additional features to EMT+, as well as polishing some of the rough edges that we collected along the way.

Built With

Share this project:

Updates