LLM Reliability Monitor
An end to end observability setup for a Gemini-powered LLM, using Datadog to monitor latency, availability, error budgets, and incidents, -- treating LLM's like production services, not black boxes.
An end to end observability setup for a Gemini-powered LLM, using Datadog to monitor latency, availability, error budgets, and incidents, -- treating LLM's like production services, not black boxes.
Log in or sign up for Devpost to join the conversation.