SkillSight AR

SkillSight AR interface demonstrating real-time accessibility challenge detection and interactive AR guidance.

Inspiration

Accessibility is often overlooked in everyday environments. Many people do not realize how difficult simple tasks can be for individuals with disabilities. We wanted to create an experience that builds empathy and awareness by letting users see and interact with these challenges directly through augmented reality.

What it does

SkillSight AR is an immersive AR experience that simulates real-world accessibility challenges. Users can explore environments where obstacles such as inaccessible ramps or pathways are highlighted. The system provides visual feedback and educational insights to help users understand why inclusive design is important.

How we built it

We built SkillSight AR using Snap Lens Studio and TypeScript. The project uses AR overlays to detect and simulate obstacles in real-world environments. Interactive UI elements provide feedback, guidance, and educational tips. The system is designed to be simple, intuitive, and engaging.

Challenges we ran into

One of the main challenges was designing realistic AR scenarios that clearly communicate accessibility issues. We also faced technical challenges in aligning AR elements with real-world environments and making interactions smooth and responsive within a limited time frame.

Accomplishments that we're proud of

We successfully created a working AR prototype that demonstrates accessibility challenges in an interactive way. We are proud of building a meaningful project that combines technology with social impact and education.

What we learned

We learned how powerful XR technology can be in creating immersive educational experiences. We also gained experience in AR development, user interaction design, and rapid prototyping under time constraints.

What's next for SkillSight AR

In the future, we plan to expand the range of scenarios, improve realism, and integrate more accessibility cases. We also aim to deploy the experience on more devices and collaborate with organizations focused on accessibility and inclusive design.