Construction sites are fast-paced environments where workers often face challenges in navigation, identifying the correct tools and components, and maintaining safety. Inspired by these real-world problems, we envisioned an intelligent hands-free assistant that provides contextual guidance directly through Meta Smart Glasses.
Our project, VisionForge AI Construction Copilot, combines Meta Smart Glasses with NVIDIA Edge AI to assist workers using computer vision, speech interaction, and contextual reasoning. The proposed system can guide workers through building floor plans, recognize construction components such as bolts, beams, and tools, recommend appropriate equipment, and perform basic PPE safety monitoring. Rather than constantly interrupting the user, the assistant is designed to provide assistance only when requested or when it detects a potentially unsafe situation.
The primary challenge is integrating multiple AI technologies—including computer vision, speech processing, and construction-specific reasoning—into a practical real-time system within the hackathon timeline. Our approach focuses on building a modular architecture and delivering a few core features reliably before expanding the system further. This project demonstrates how wearable AI can improve productivity, reduce errors, and enhance safety on construction sites.
Log in or sign up for Devpost to join the conversation.