Medical providers are under enormous daily stress. Research has shown that excess stress leads to a poor learning environment for trainees and is associated with worse surgical performance, increased risk of serious procedure-related complications, and a higher rate of intraoperative mistakes.
What it does
jARvis is a smart, real-time stress monitoring assistant designed for an augmented reality HUD. jARvis transforms a continuous stream of user biometric sensor data into a live, visual representation of emotional state made more accurate over time via machine learning. If the user’s stress level reaches an evidence-based, dangerous threshold associated with critical error, jARvis will alert its user and recommend a brief mindfulness breathing intervention to help down-regulate emotional state.
How we built it
jARvis was built in Arduino and Unity.
Challenges we ran into
Connecting our hardware biometric sensor to Unity via Bluetooth.
Accomplishments that we're proud of
Connecting our hardware biometric sensor to Unity via Bluetooth. Making an immersive Unity experience from almost zero Unity experience.
What we learned
Working with hardware is HARD! From designing a wearable device, to ensuring accurate data collection, to testing proper device functionality, to linking hardware with software, the “hardware” track challenged us and helped us to divide our diverse skills in order to triage problems in order of priority.
What's next for jARvis
jARvis will require rigorous study to become an evidence-based medical tool. If validated, jARvis may be developed for other industries that require high-stakes, high-stress decision-making, such as in military aviation, Formula 1 racing, and NASA space-walks, where remote monitoring via real-time data streams are needed for the most accurate and immersive feedback experiences.