TEAM : ELECZOO

Inspiration

We took inspiration from InspectAR, which is a paid solution (1000$) for PCB inspection with augmented reality.

We wanted to propose a free, open source and evolutive alternative for hobbyist.

What it does

Our project goal is to simplify the vizualisation of electronic circuits, for a faster and simpler production. It would also be of great value for our troubleshooting workflow.

The main idea consists of a camera showing us technical details of a circuit through an augmented reality interface.

How we built it

We decided to integrate our system in an existing tool called Interactive BOM.

Interactive BOM is a plugin that generates convenient BOM listing with ability to visually correlate and easily search for components and their placements on the pcb.

A bill of materials (BOM) is a list of components that need to be mounted on a circuit. We wanted to add a usefull feature to this open source plugin.

Our full pipeline consists of :

Getting a camera feed using the openCV API
Getting existing PCB data (tracks and footprints positions) from the interactive BOM plugin
We generate a drawing of the board, each time a filter is applied in the interactive BOM.
For each frame of the camera feed, we resize and warp the drawing depending on the POV of the camera. We'll then merge the recomposed drawing with the original camera feed.
This final camera feed is then streamed out to a flask server. We then integrate the feed into an I-frame on the interactive BOM web page.