Tag: #트레이싱
Kubernetes, DevOps and MLOps, written from things we ran and measured ourselves · 1 posts
Observing LLM Serving with OpenTelemetry: Actual Signals from vLLM, The Distance from Standards, and Filling the Gap with a Collector
We turned on OpenTelemetry tracing in vLLM and attached a collector to directly measure what spans and attributes a single request leaves, what metric names appear, the overhead of turning it on, and how it differs from
2026-10-08 · 25 min read #OpenTelemetry#OTCA#vLLM#트레이싱#컬렉터