Tag: #optimization

Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 23 posts

LLM Inference Optimization: In-Depth Analysis of vLLM and TensorRT-LLM ♪ Listenable
Analyzing core LLM inference optimization techniques including PagedAttention, Continuous Batching, and quantization, based on the official documentation of vLLM and TensorRT-LLM.
2026-03-01 · 22 min read #llm #inference #vllm #tensorrt-llm #optimization
FlashAttention: Optimizing Attention Through GPU Memory Hierarchy
A review of the FlashAttention paper with an in-depth analysis of IO-aware attention optimization leveraging the GPU HBM/SRAM memory hierarchy.
2026-03-01 · 18 min read #ai-papers #flash-attention #gpu #optimization #transformer
Complete Guide to GPU Memory Optimization and Mixed Precision Training ♪ Listenable
Analyze GPU memory components based on NVIDIA official documentation and cover memory optimization techniques including Mixed Precision Training and Gradient Checkpointing.
2026-03-01 · 22 min read #gpu #cuda #mixed-precision #optimization #deep-learning

LLM Inference Optimization: In-Depth Analysis of vLLM and TensorRT-LLM ♪ Listenable