Inspiration

  • Late night scrolling session on Instagram Reels, watching construction fails where workers accidentally damage fiber optic cables buried underground and cause expensive holdups and delays.

What it does

  • Watchdog uses Spacial AR to help construction workers visualize the depth and locations of pipes instead of relying purely on crudely sprayed markings that later get wiped away or obstructed by later work. An overhead view or snapshot of the worksite relayed to an Arduino UNO-Q will provide workers with a pin-point accurate visual representation of the underground layout.

How I built it

  • By building and testing constantly on my laptop with the webcam connected with my phone put in developer mode in tandem with Xcode. After verifying everything works, I deployed software onto Arduino UNO-Q and made it stand alone with its own Wifi system instead of my phone hotspot.

Challenges I ran into

  • Spacial AR losing tracking when markers are offscreen
  • Visual representation kept tilting from ground level
  • Trouble keeping all devices tethered via Wifi

Accomplishments that I am proud of

  • Accurate spacial augmented reality implementation with minimal error (~1.5cm error)
  • Completely offline design that connects all apps and devices using a local wifi generated by the Arduino UNO-Q
  • Arduino UNO-Q and camera are completely standalone, running on battery and works on boot-up

What I learned

  • Xcode can simulate apps in real time on my own iPhone, making it significantly easier to build with and test.
  • A one man team is very difficult to run. Next time, I will bring teammates.

What's next for Watchdog

  • Implement a well-trained, light weight AI vision model to better recognize real world scenarios
  • Create a modular design where it can be attached to various objects or materials such as snapping onto a drone or suctioning onto a ceiling.
  • Better calculations for lens distortion based on type of camera used on Arduino UNO-Q
Share this project:

Updates

Submission history