Sentinel AI Guardian –Gemini Live Agent for Real‑Time Safety

Sentinel AI Guardian: Your Live Gemini Agent That Sees, Hears & Protects Women Walking Alone at Night

Comment

Inspiration

Every night, thousands of women leave work gripped by fear. 81% avoid walking alone after sunset due to harassment risks and dark streets.

As a CS undergrad at BITS Pilani Dubai witnessing friends taking Ubers or avoiding evening walks, I built Sentinel AI Guardian a real-time multimodal Gemini Live Agent that analyzes camera feed, GPS, and audio to detect threats before they escalate.

This isn't just code. It's personal safety powered by AI.

What it does

Sentinel Guardian is a real-time multimodal Gemini agent that analyzes camera + GPS + audio to detect harassment risks on dark streets.

Core flow: "Am I safe?" voice query → Instant sensor fusion Vision: Dark alleys, low lighting, crowd density, followers GPS: Nearest police stations, safe routes Audio: Footsteps, shouts, anomalies Gemini decision: Risk score → Spoken response + emergency actions

How we built it

Frontend (Vercel): React + Vite + Tailwind + Shadcn UI Backend (Cloud Run): Node.js/Express + Google GenAI SDK + Docker AI: Gemini Vision API for camera analysis Infra: Google Maps API + Cloud Run logs

Challenges we ran into

Vision hallucinations: Gemini saw "crowds" in empty streets Fix: Grounding with GPS + lighting (lux<10=+30%risk) Cloud Run cold starts: 500ms latency spikes Fix: min-instances=1 → <200ms responses

Accomplishments that we're proud of

Live deployment: sentinelaigaurdian.vercel.app + Cloud Run backend ​Multimodal fusion: First agent combining vision + GPS + audio for safety Live video demo: 3:55 video telling Priya's real story → Technical logs proof Hackathon-ready: All mandatory requirements

What we learned

Gemini's live multimodal streaming enables sub-second safety decisions, perfect for life-critical apps.

Key learnings: Always ground multimodal outputs (GPS > vision alone) Cloud Run scales beautifully for AI backends with proper config

What's next for Sentinel AI Guardian - Gemini Live Agent for Real‑Time Safety

Wearables: Smartwatch haptics + Arabic voice Blockchain: Tamper-proof location logs Scale: Community safety map (crowd-sourced risk zones) Google Cloud Next 2026: Live demo + production rollout

Sentinel proves Gemini Live Agents can save lives.

Live: sentinelaigaurdian.vercel.app

Built With

Share this project:

Updates