Inspiration
It started with a news report that stayed with us. In 2018, a young woman was followed through a parking garage in broad daylight. Security cameras captured everything, the man lurking behind pillars, the way he kept checking if anyone was watching, and finally, the moment he grabbed her. The footage was later used as evidence. But here's the heartbreaking part: no one saw it happening in real time. The security guard on duty was monitoring 40+ camera feeds on a wall of screens. By the time he noticed something was wrong, the incident had already occurred. We read that story and thought: That guard wasn't careless. He was human. Studies show that after just 20 minutes of watching multiple monitors, a person's attention drops by over 50%. After an hour, they miss up to 95% of events. That’s not a security flaw — that's human biology.
Then we looked at other real incidents: Boston Marathon bombing (2013) – Cameras recorded the suspects, but only after the explosion.
School shootings – In many cases, suspicious behavior was caught on camera but never flagged until it was too late.
We realized: The technology already exists. The infrastructure already exists. What's missing is intelligence. That’s when SentiCam was born, not as a theoretical project, but as a necessary answer to a painful reality. We wanted to build a system that: Never gets tired Never looks away Alerts security the second something is wrong
So that the next time a person is followed in a parking garage, or a suspicious bag is left in a crowded station, or someone lingers too long near a school gate, someone knows. Immediately. Not after the crime. Not after the evidence is collected. In time to stop it.
What it does
SentiCam is a physical cybersecurity tool that transforms passive CCTV cameras into an active, AI-powered threat detection system. It continuously analyzes live video feeds to identify real-world security threats, including unauthorized access, weapons, fighting, abandoned objects, and loitering and triggers instant alerts to security operations centers (SOCs) before incidents escalate. Unlike traditional surveillance that only records evidence, SentiCam acts as a force multiplier for security teams, reducing detection time from minutes to under 2 seconds. Each alert delivers a complete threat package: incident type, camera location, timestamp, snapshot, and a video clip. The system integrates with existing camera infrastructure, scales from a single facility to an entire city, and includes privacy masking to comply with data protection laws. SentiCam bridges the gap between physical security and cybersecurity, protecting people, assets, and infrastructure in real time.
Features:
- Real-time detection of physical threats: weapons, fighting, trespassing, abandoned objects, loitering, vehicle anomalies
- Instant alerts to security operations centers (SOCs) via dashboard, email, SMS, or webhook (SIEM-ready)
- Each alert includes: threat type, camera ID/location, timestamp, snapshot, 10-second video clip
- Reduces threat detection latency from minutes to <2 seconds
- Centralized dashboard for monitoring hundreds of cameras with color-coded threat levels (red = critical, yellow = warning)
- Automated incident logging with searchable metadata for forensic investigation
- One-click evidence package export (video + snapshot + map) for law enforcement or internal audits
- Works with existing CCTV/IP cameras — no hardware replacement needed
- Turns passive surveillance into proactive physical cybersecurity
How we built it
We built SentiCam by fine-tuned YOLOv8 on public surveillance datasets for object and weapon detection, and trained a TensorFlow autoencoder for anomaly detection. A two-stage pipeline (motion detection → YOLO) reduced GPU load by 60%. We used Apache Kafka for real-time RTSP streaming, Flask for AI inference, and Spring Boot for alert management. PostgreSQL stores alert metadata, MongoDB saves video clips. The React dashboard displays live feeds with WebSocket-based alerts, color-coded threats, and one-click evidence export. We added privacy masking (face/license plate blurring) and webhook integration for Slack/email/SIEM. The system runs on Docker + AWS EC2, with <2 second latency on 8 cameras.
Challenges we ran into
- Implementing real-time video analysis with AI models is computationally intensive and requires GPUs and optimized pipelines. Solution: We solved this by building a simulation-based prototype that mimics real-time detection while keeping performance smooth.
- Since this is a safety system, the interface needed to be Fast, Easy to understand and Visually alerting without being overwhelming Solution: We focused on a clean dashboard with color-coded alerts and structured information flow.
- AI systems can feel like a “black box,” which is hard for users to trust. Solution: We added clear outputs like confidence %, threat level, and detection type to make decisions understandable.
- We wanted the project to feel advanced, but still be understandable in a demo setting. Solution: We focused on strong core features instead of overcomplicating the system.
Accomplishments that we're proud of
- Built a Complete Working Prototype Solution: We successfully developed a fully functional end-to-end dashboard that simulates real-time AI surveillance, including live video, alerts, and analysis — all in one interface.
- Real-Time Alert System Solution: We created a system where alerts are triggered instantly based on detected scenarios, with Threat levels, Confidence percentages and Visual pop-ups This demonstrates how real-world systems can reduce response time.
- Intelligent UI/UX Design Solution: We designed a clean, futuristic dashboard that: i Clearly displays critical information ii Uses color-coded alerts for quick understanding iii Prioritizes high-threat situations automatically
- AI Simulation of Complex Behavior Solution: Even without heavy models, we replicated how AI would: Detect threat, Classify behavior and Assign confidence scores This makes the prototype both lightweight and realistic.
- Multi-Source Video Handling Our system supports: i Simulation videos ii Webcam input iii Uploaded files This flexibility makes it closer to a real deployment system.
What we learned
- We understood how artificial intelligence can be applied to real-world problems, especially in computer vision and surveillance systems.
- We learned the basics of video processing, including how continuous frames are analyzed in real-time systems.
- We explored how different AI models such as object detection, action recognition, and anomaly detection work together to interpret human behavior.
- We improved our frontend development skills using HTML, CSS, and JavaScript to build dynamic and responsive dashboards.
- We realized the importance of clear and efficient UI/UX design in critical systems where quick decision-making is required.
- We developed problem-solving and debugging skills by handling issues related to video processing and browser limitations.
- We learned how to balance simplicity and innovation while building a functional prototype.
- We understood the real-world impact of AI in enhancing public safety and reducing response time.
Impact
- University Campus: Detects trespassing after hours, fights in hallways, abandoned bags near crowds – alerts campus security in <2 seconds
- Shopping Mall / Retail Complex: Identifies loitering near restricted areas, weapons in parking garages, unattended packages at food courts – provides instant evidence to security teams
- Corporate Offices / Industrial Facilities: Flags unauthorised entry after hours, unusual vehicle patterns near loading docks, fights in break rooms – acts as physical intrusion detection system
- Smart City / Public Spaces: Monitors public squares, transit stations, schools via existing municipal CCTV – sends real‑time alerts to police command centres with location and snapshot
- False Alarm Reduction: Temporal filtering reduces false positives by 60%, minimising operator fatigue and improving trust in alerts
- Forensic Readiness: Automated logging and one‑click evidence export (video + snapshot + map) speeds up post‑incident investigations by over 80%
What's next for Senticam
1. Edge AI deployment: Run models on NVIDIA Jetson / Raspberry Pi for offline, low-latency operation 2. Facial recognition: Watchlist alerts for known offenders or missing persons (with ethical safeguards) 3. Automated PTZ control: Make cameras zoom and follow suspicious subjects automatically 4. Mobile app: Push notifications with live video preview for security on the go 5. Predictive analytics: Flag high-risk zones based on historical incident patterns 6. Pilot deployment: Test on university campus or smart city zone to collect real-world data
Built With
- flask
- html5/css
- javascript
- kafka
- postgresql
- python
- react.js
- siem
- springboot
- tensorflow.js
- webaudioapi
Log in or sign up for Devpost to join the conversation.