Project Proposal — BuildLens AI
AI-Powered Construction Site Inspection Assistant using Meta Glasses
The Problem
Construction inspections run on memory and paperwork. Site engineers make critical quality and safety decisions at the work face, while the information those decisions depend on drawings, specifications, SOPs, NCRs, and inspection history sits scattered across systems in the site office. The consequences, ranked by impact:
- No real-time decision support — engineers rely on memory or walk back to check documents; critical context is missing at the moment decisions are made.
- Knowledge trapped in documents — drawings, SOPs, NCRs, and past inspections live in silos; engineers waste time searching or miss important context entirely.
- Manual, inconsistent reporting — hours spent after each inspection writing reports and attaching photos, causing delays and inconsistent records.
- Late defect discovery — cracks, honeycombing, and exposed rebar are caught only in manual review, inflating rework costs and safety risk.
- Undetected PPE violations — supervisors can't watch every worker; missing helmets or harnesses go unnoticed until an incident.
- Manual OSHA compliance — verifying and documenting compliance is slow and error-prone, risking penalties, failed audits, and delays.
The Proposed Solution
BuildLens AI pairs Meta Glasses (camera + mic + speaker) with an AI backend , LLM + RAG, computer vision, and speech to put contextual intelligence directly into the inspection walk. Six capabilities, one per problem:
- AI Site Inspection Assistant — voice-guided inspection checklists and instant answers at the point of decision ("what's the specified rebar spacing here?"), plus an executive walkthrough mode for status briefings.
- Smart Document Retrieval (RAG) — ask in natural language; get cited answers from drawings (revision-aware), specs, SOPs, NCRs, and inspection history in ~3 seconds.
- Automatic Report Generation — narrate the walkthrough; receive a structured inspection report with photos and video evidence, ready for PM sign-off.
- Intelligent Defect Detection — CV detects cracks, honeycombing, exposed rebar, and spalling from glasses frames, classifies severity, and auto-drafts NCRs for human disposition.
- PPE Compliance & Supervisor Alerts — real-time detection of missing helmets, vests, and harnesses; audio alert to the wearer in ≤2s and push alert to the zone supervisor in ≤5s.
- OSHA Compliance Monitoring & Automated Reporting — every violation auto-mapped to its 29 CFR 1926 clause; weekly compliance reports generated automatically with a full audit trail.
Built With
- android
- android-studio
- bluetooth
- computer-vision
- fastapi
- jetpack-compose
- kotlin
- llm
- machine-learning
- meta
- meta-wearables-sdk
- opencv
- postgresql
- python
- qdrant
- rabbitmq
- rag
- ray-ban-meta
- redis
- speech-recognition
- text-to-speech
- wearables
- websockets
- whisper
- yolov8
Log in or sign up for Devpost to join the conversation.