Locked in Vision

Computer Vision
UI
Facial Safety Check
Table Set up
Camera Set up

Inspiration

Locked in Vision was born from the factory floor: where one missed step, one wrong part, or one unchecked detail can become rework, scrap, or risk. We wanted to build a smarter MPI system that does not just display instructions, but actually sees the work being done and verifies reality in real time.

What it does

Locked in Vision uses computer vision to guide and verify an assembly process. For our demo, the system detects colored blocks inside an assembly area and confirms that they are placed in the correct sequence before unlocking the work order. It turns a normal checklist into a living process: the operator acts, the camera verifies, and the system only passes when the physical work is correct.

How we built it

We built it with a Python vision bridge, a FastAPI backend, and a frontend work-instruction UI.

The camera detects the blocks, the backend validates the sequence, and the UI shows the operator what step they are on. The backend is the source of truth, so the process cannot be passed by a fake button or frontend shortcut.

Challenges we ran into

The hardest part was making the real world behave like software. Camera indexes failed, detections froze, ports conflicted, and blocks sometimes appeared visually correct but were not recognized by the system.

We also had to cut the demo down to its strongest idea: block verification. Three minutes is short, so we removed extra tool and PPE steps to keep the story sharp.

Accomplishments that we're proud of

We are proud that this is not just a dashboard. It connects the digital instruction to the physical assembly space. The system proves a powerful idea: manufacturing software should not only tell operators what to do. It should help verify that the work was actually done right.

What we learned

We learned that computer vision is powerful, but unforgiving. Lighting, camera angle, confidence thresholds, and zone calibration all matter.

We also learned that a good demo is not about adding more features. It is about showing one clear truth with confidence.

What's next for Locked in Vision

Next, we want to make Locked in Vision more reliable, flexible, and production-ready. That means better calibration, stronger detection, snapshots for audit trails, and support for real manufacturing objects like tools, parts, labels, PPE, and fixtures.

The bigger vision is a smart MPI system that protects quality, supports operators, and creates trustworthy evidence automatically.

Locked in Vision is the first step toward work instructions that do not just guide the process, but verify the truth.