Inspiration We noticed that industries like manufacturing, construction, and infrastructure rely heavily on manual inspections to detect small visual changes over time. This process is time-consuming and often misses critical issues. We wanted to build something that could see and analyze visual changes automatically, helping teams make faster, data-driven decisions.
What it does Visual Difference Engine (VDE) automatically detects, classifies, and explains visual differences between two or more images taken over time. It highlights changes using heatmaps, labels them (e.g., “new object,” “damage,” “missing part”), and even generates a short, readable report. It’s like a “visual detective” that works across use cases — from factory lines to satellite monitoring.
How we built it We started by gathering open-source datasets like LEVIR-CD (for remote sensing) and MVTec (for industrial defects). Used OpenCV for image alignment and preprocessing. Built a Siamese U-Net model in PyTorch for change detection. Added a FastAPI backend for serving predictions. Designed a React frontend with an interactive slider to compare before-after images visually. Integrated it all into a simple web-based dashboard.
Challenges we ran into Aligning images perfectly when taken from slightly different angles. Avoiding false detections due to lighting or shadow differences. Balancing model accuracy and inference speed for real-time performance. Connecting the ML pipeline smoothly with the frontend for visual output.
Accomplishments that we're proud of Successfully built an AI model that detects subtle visual changes with high accuracy. Created a working prototype that’s domain-agnostic and can be used in multiple industries. Designed a clean, minimal UI that makes complex image analytics understandable. Learned to combine traditional computer vision and modern deep learning effectively.
What we learned We learned the power of hybrid AI systems — how combining classical image processing with deep learning brings stability and precision. We also learned about real-world deployment challenges like model optimization, explainability, and usability.
What's next for Visual Difference Engine (VDE) We plan to: Add real-time edge deployment for on-site defect detection. Introduce API integrations for easy plug-in with inspection workflows. Expand into multi-sensor analysis (e.g., thermal + visual). Launch a cloud dashboard for large-scale infrastructure and compliance monitoring.
Built With
- amazon-web-services
- docker
- fastapi
- github
- google-cloud-vision-api
- google-cloud-vision-api-database:-mongodb-atlas-tools-&-platforms:-hugging-face-datasets
- huggingface-datasets
- javascript
- javascript-frameworks:-pytorch
- mongodb
- numpy
- opencv
- pandas
- python
- pytorch
- react
- react-libraries:-opencv
- tensorflow
- tensorflow-lite-cloud-services:-aws-s3
Log in or sign up for Devpost to join the conversation.