HawkEye

HawkEye is a real-time threat monitoring system that detects dangerous human activity from CCTV footage. Built with Flask, YOLOv8, and Google Gemini Vision, it automatically analyzes human movement in video files and sends email and phone alerts when suspicious behavior is detected.

📌 About the Project HawkEye focuses primarily on backend technology — combining real-time object detection, contextual AI analysis, and intelligent alerting — to build a meaningful safety solution. While a basic frontend dashboard is included for demonstration purposes, the core innovation lies in the detection and analysis pipeline.

💡 Key Features 📂 Uses YOLOv8 to detect humans and movements in CCTV-like footage (runs locally) 🎥 Live camera monitoring with real-time threat detection 🤖 Uses Google Gemini Vision to analyze screenshots for dangerous behavior (cloud API) ✉️ Sends detailed email alerts with images and structured threat logs 📞 Makes automated phone calls for critical threats (Twilio) 🔒 Supports privacy masking and multi-level threat detection 🧍‍♂️ Tracks people across multiple frames for consistency 📈 Provides advanced analytics and visual logs 📢 Supports external alarm system triggers 📁 Stores logs and reports for post-event investigation ⚙️ Backend-driven — minimal dependencies and frontend bloat 📽 Intended Use HawkEye is designed to run locally on systems such as:

Schools Retail environments Residential security systems Live monitoring scenarios (using built-in or external cameras) It currently processes local video files and live camera feeds, and requires internet for AI-based analysis, but future versions will support offline AI models for complete local operation.

🧪 How It Works Video File Monitoring Select a video file (placed in /static/videos/) Optionally enable email alerts Click Start Monitoring The system processes the video file for threats Live Camera Monitoring Go to the Live Camera Monitoring section Select your camera from the dropdown Optionally enable email alerts and privacy blur Click Start Live Monitoring The system monitors your camera feed in real-time Detection Process The system:

Detects human movement and extracts frames (YOLOv8, local) Applies AI for scene interpretation and threat assessment (Gemini Vision, cloud) Sends email and phone alerts for threats (if enabled) Logs activity with timestamps, labels, and screenshots Logs are accessible at:

/logs: General activity logs /logs/action-required: Only critical or high-risk events

Built With

• flask
• generative-ai
• numpy
• opencv
• pandas
• scipy
• yolov8