XRperience_2024_Hackathon_<XL_Beans>

Empowering Health through Augmented Reality

Inspiration

Our inspiration comes from "Be My Eyes," an application that leverages augmented reality to simulate various eye conditions. We aimed to extend this innovative concept to help users understand a broader range of medical conditions through a compelling AR experience.

What It Does

The application uses the camera of a mobile phone to scan and analyze live images of medical conditions, such as injuries, diseases, and other health issues. Upon scanning an image, the application displays a pop-up with detailed information about the condition, including symptoms, preventive measures, and treatment options. This feature educates users on the severity of the condition and provides guidance on whether it requires immediate attention.

How We Built It

Our application was developed using Unity 2022, with C# employed for scene management and image detection. We also utilized TextMeshPro plugins to create a user-friendly and visually appealing interface. The development process involved using AR Mobile in Unity to facilitate accurate image detection and scene creation.

Challenges We Faced

Adapting to new software and a different programming language was a significant hurdle. Our team dedicated substantial time to learning and mastering these tools to ensure the successful execution of our project.

Accomplishments We're Proud Of

We are incredibly proud of our achievement in creating a functional and impactful product. The collective efforts and innovative thinking of our team have resulted in an application that can significantly aid in medical education and awareness.

What We Learned

This project was a profound learning experience, exposing us to new techniques in application development. We expanded our technical knowledge and discovered novel methods to create effective and engaging applications.

What's Next for XRperience_2024_Hackathon_

Looking forward, we aim to integrate advanced machine learning algorithms to enhance the application's ability to scan and identify a wider range of images and real-life conditions. We also plan to expand our reach by developing an iOS version of the application. Our goal is to continuously improve the application's functionality and user experience, making it a valuable tool for medical education and awareness on a global scale.