Here's the actual YouTube link. Uploading just finished.
City Sim Agent Benchmark
An agent must fix a city it cannot see, using only SQL. Four modes: no DataHub, DataHub docs, DataHub docs plus live assertions, and DataHub's own agent. Same model, same crisis. Measured.
Log in or sign up for Devpost to join the conversation.