Tag: #모델 배포
Kubernetes, DevOps and MLOps, written from things we ran and measured ourselves · 1 posts
Measuring LoRA Adapter Serving Directly: Throughput Cost, Adapter Slots, and Dynamic Loading
I directly measured with a 1.7B model and vLLM how much throughput drops when serving multiple LoRA adapters on a single base model, what happens when the number of adapters exceeds the number of slots, and how long it t
2026-10-07 · 19 min read #LoRA#vLLM#멀티 어댑터#서빙#처리량