llamatelemetry
Llamatelemetry provides real-time observability for LLM inference running on GPUs. It captures telemetry using OpenTelemetry, visualizes execution graphs, and streams metrics to Grafana dashboards.
Llamatelemetry provides real-time observability for LLM inference running on GPUs. It captures telemetry using OpenTelemetry, visualizes execution graphs, and streams metrics to Grafana dashboards.
Log in or sign up for Devpost to join the conversation.