Tag: #max-model-len
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
Inside vLLM (6) — Context Window vs max_model_len vs max_tokens, Fully Explained
If the difference between context window and maxtokens has been confusing, this single post sorts it out. Covers what each of the following actually limits, with a comparison table and real error messages: the context wi
2026-08-12 · 12 min read #vllm#context-window#max-model-len#max-tokens#llm