SetGhost

As filmmakers and developers navigating production workflows, i've seen how easily minor continuity errors (like a shifting prop, missing wardrobe, or changing lighting) slip past human supervision on set. In post-production, catching these errors too late forces costly, schedule-wrecking reshoots. i built SetGhost to solve this by introducing autonomous AI supervision directly onto the film set.

SetGhost is an autonomous multi-agent AI line producer and script continuity engine. It features:

• Agent 1 (Visual Supervisor): Uses Google's Gemini multimodal models to ingest reference frames and current takes, performing rigorous pixel-and-object-level continuity analysis.
• Agent 2 (Script Doctor & Crisis Dispatcher): Automatically triggers via an Agent-to-Agent (A2A) protocol when discrepancies are flagged, generating professional industry-standard screenplay revisions (.fdx layout) and instant crew call-sheet bulletins to narratively conceal the error.

• ClickHouse Cloud Lakehouse: High-throughput, real-time structured telemetry logging capturing microsecond timestamps, discrepancy scores, and automated fixes.

• Backend & API: Python, FastAPI, and Uvicorn for asynchronous real-time server handling.

• Vision & Intelligence: Google GenAI SDK (gemini-2.5-flash) with structured JSON parsing for multimodal frame analysis.

• Data Persistence: ClickHouse Cloud for lightning-fast high-throughput telemetry storage.

• Frontend & Visualization: Tailwind CSS, HTML5, and Three.js for an interactive 3D camera rig telemetry dashboard.

Handling binary image uploads across cloud agent simulators and mapping multi-agent asynchronous handoffs required precise payload structures. I also built robust error-handling to ensure that when Agent 1 passes high-discrepancy data to Agent 2, the structured JSON array parses seamlessly into ClickHouse tables without blocking the main event loop.

• Successfully executing a true Agent-to-Agent (A2A) workflow where visual computer vision data triggers autonomous scriptwriting and operational dispatch.
• Integrating a high-throughput columnar database (ClickHouse Cloud) that instantly logs real-time production metadata with sub-millisecond query performance.
• Creating a fully immersive, Hollywood-grade dark-slate terminal interface complete with an interactive Three.js 3D optical rig.

I gained deep technical experience in multi-agent orchestration paradigms, multimodal prompt engineering for precise visual analysis, and connecting local Python microservices to cloud data lakes.

What's next for SetGhost

• Expanding the agent mesh to include a Budget & Scheduling Agent that calculates the financial impact of discovered continuity errors in real-time.
• Deploying edge-computing modules for on-set wireless camera ingestion.

Built With

• clickhouse
• fastapi
• google-gemini
• python
• render
• tailwind-css
• three.js