JaundiceXR

Inspiration & What it does

Meta Quest Jaundice Detection App is a Unity-based VR experience that turns the Quest headset into a hands-free jaundice screening helper. Using the headset camera, it captures photos of the face and runs local color analysis to detect yellow discoloration, with optional SensAIKits integration for AI-powered face and eye region detection via Meta Camera Access (PCA). The app provides instant, easy-to-read feedback and confidence scores, controlled entirely through Quest controllers. It is designed strictly for educational and research use and is not a medical device or diagnostic tool.

How we built it

Our Meta Quest Jaundice Detection App is a Unity-based VR experience that turns the headset into a hands-free helper for spotting potential neonatal jaundice using the Quest camera. Inside VR, the user can capture a face photo upload to an app which runs a custom color analysis pipeline—using HSV color space and RGB ratios focused on yellow hues—to estimate jaundice risk and display instant feedback with a confidence score. We built it with Oculus/Meta Quest Integration for XR and controller support, and an optional enhanced mode that integrates SensAIKits and Meta Camera Access (PCA) for AI-powered face/eye region detection and more targeted analysis of the sclera and skin. Throughout, we framed it strictly as an educational and research tool—not a medical device—to explore how VR and lightweight vision techniques could support neonatal training and awareness in an accessible way.