Tag: #Dynamo
Kubernetes, DevOps and MLOps, written from things we ran and measured ourselves · 1 posts
Automating LLM Serving Deployment with Kubernetes CRDs and Operators
LLM serving is difficult to express using Deployment alone because the unit of scaling is a bundle of pods rather than a single pod. CRDs and operators such as LeaderWorkerSet, KServe, and Dynamo handle this. We examine
2026-10-08 · 48 min read #쿠버네티스#CRD#오퍼레이터#LeaderWorkerSet#KServe