Tag: #gpu-optimization
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Complete LLM Inference Optimization Guide 2025: vLLM, TensorRT-LLM, KV Cache, Speculative Decoding ♪ Listenable
Everything about LLM inference optimization! vLLM (PagedAttention), TensorRT-LLM (FP8/INT4), KV Cache management, Speculative Decoding, Continuous Batching, FlashAttention, Quantization (GPTQ/AWQ/GGUF), Model Serving (Tr
2026-04-14 · 25 min read #llm-inference#vllm#tensorrt-llm#kv-cache#speculative-decodingFlashAttention Paper Analysis: Revolutionizing Transformer Training and Inference with IO-Aware Exact Attention ♪ Listenable
An in-depth analysis of the FlashAttention series (v1 through v3). Covers the tiling strategy of the IO-aware algorithm, GPU SRAM/HBM memory hierarchy utilization, backward pass recomputation, parallelism improvements in
2026-03-09 · 22 min read #ai-papers#flash-attention#transformer#gpu-optimization#attention-mechanism