Tag: #scheduler
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 9 posts
9 posts are tagged #scheduler; the most recent was published on 2026-08-12.
Often tagged together: #kubernetes 3 #cgroups 2 #kernel 2 #linux 2 #spring-batch 2
Most read in the last 90 days:
Inside vLLM (4) — The Scheduler and Preemption, Where Throughput Collapses ♪ Listenable
Explains what the vLLM scheduler decides on every step, how the waiting queue and running list move, and how preemption, triggered when the KV cache runs short, wrecks latency and throughput, verified against the officia
2026-08-12 · 7 min read #vllm#scheduler#preemption#kv-cache#llmMaking vLLM Fast — Configuration, Internals, and Where to Actually Touch the Code ♪ Listenable
A step-by-step walk through improving vLLM performance, starting from everything you can fix without touching code. Covers batching-related arguments, prefix caching, chunked prefill, and quantization choice first, then
2026-08-02 · 21 min read #vllm#llm-inference#paged-attention#benchmark#schedulerFixing Kubernetes Pod Pending — How to Read the Rejection Reason the Scheduler Left Behind
When a Pod sits in Pending for minutes on end, the scheduler has already recorded the rejection reason in an event. We start with how to decode precisely that sentence beginning with 0/5 nodes are available, then rule ou
2026-07-26 · 14 min read #kubernetes#scheduler#pending#troubleshooting#autoscalingsched_ext Sub-Schedulers — the Per-cgroup Scheduler That Arrived Half-Done in Kernel 7.1
Linux 7.1 (released June 14, 2026) landed cgroup sub-scheduler support for schedext. The goal is clear — attach a BPF scheduler anywhere in the cgroup tree, let parent schedulers dynamically allocate CPU to their childre
2026-07-16 · 13 min read #linux#kernel#scheduler#cgroups#bpfThe Evolution of the Linux CPU Scheduler — From CFS to EEVDF
We follow the evolution of the Linux scheduler, from CFS implementing fairness with vruntime and a red-black tree, to EEVDF which became the default in kernel 6.6 to address latency-sensitive workloads. Covers cgroup CPU
2026-06-13 · 17 min read #linux#kernel#scheduler#cfs#eevdfBatch and End-of-Day Processing in Banking — The Architecture That Rules the Night
Why batch processing remains central in banking and the full picture of end-of-day (EOD) processing. We cover job schedulers and dependency DAGs, checkpoint restarts, partitioning and chunk processing, center-cut and dat
2026-06-13 · 18 min read #finance#batch#eod#spring-batch#schedulerKubernetes Internals Complete Guide — etcd, API Server, Controller, Scheduler, kubelet, CRI/CNI/CSI Deep Dive (2025)
Everything about Kubernetes internals — history from Google Borg, etcd Raft consensus, API Server REST and watch protocol, scheduler filter/score algorithms, controller manager reconciliation loops, kubelet Pod lifecycle
2026-04-15 · 11 min read #kubernetes#etcd#controller#scheduler#kubeletKubernetes Advanced Operations Guide 2025: Autoscaling, Scheduling, Resource Management, Multi-Cluster
Everything about K8s advanced operations! Autoscaling (HPA/VPA/KEDA/Karpenter), Scheduling (Affinity/Taint-Toleration/Priority/Topology), Resource Management (QoS/LimitRange/ResourceQuota), Multi-Cluster (Cluster API/Fle
2026-04-14 · 15 min read #kubernetes#hpa#vpa#keda#schedulerSpring Boot Batch Complete Guide: Job, Step, Chunk Processing and Production Patterns
Complete guide to Spring Boot Batch — Job/Step/Chunk model, ItemReader/ItemProcessor/ItemWriter, partitioning, parallel processing, scheduler integration, and monitoring.
2026-03-17 · 12 min read #spring-boot#spring-batch#batch-processing#job#chunk