sitesense

Inspiration

Construction accidents are often predictable but not prevented. Weather conditions like strong winds and heavy rain significantly increase risks such as collapsing walls, unstable scaffolds, and falling objects. We wanted to use Meta smart glasses to deliver timely, hands-free warnings directly to the workers who need them most.

What it does

SiteSense combines live weather forecasts, a digital site model, and worker locations to predict hazards before they happen. Workers receive real-time visual and voice alerts through Meta smart glasses, while supervisors monitor hazards and acknowledgments on a dashboard.

How we built it

We built a rules-based risk engine that analyzes weather data, evaluates construction-site hazards, and matches them with worker locations. The system then sends personalized HUD and voice alerts to affected workers through Meta smart glasses.

Challenges we ran into

Our biggest challenge was designing a system that is both accurate and explainable. We also had to ensure workers only receive relevant alerts to avoid unnecessary distractions.

Accomplishments that we're proud of

Built a predictive safety system instead of a reactive one. Designed personalized, location-aware hazard alerts. Combined weather forecasting, spatial awareness, and wearable technology into one solution.

What we learned

We learned that effective safety systems depend as much on reliability and clear communication as they do on AI. Simplicity and explainability are essential in safety-critical applications.

What's next for SiteSense

Next, we plan to integrate vision-language models for camera-based hazard detection, add multilingual voice support, enable offline functionality, and develop automated compliance reporting for construction sites.