Tag: #dataflow
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
Systolic Arrays and Dataflow Architecture — The Heart of the TPU ♪ Listenable
A deep dive into the systolic array, the structure that lets AI accelerators run matrix multiplication efficiently, complete with ASCII diagrams. We walk through dataflow strategies like weight-stationary and output-stat
2026-06-16 · 20 min read #gpu-cuda#systolic-array#dataflow#tpu#ai-hardwareMaking Inference Fast — Quantization, Sparsity, and Dataflow from a Hardware Lens
We break down the cost structure of inference through the memory-wall lens, then connect quantization (INT8/FP8/FP4), structured sparsity (2:4), dataflow architectures, operator fusion, batching and KV caching into one p
2026-06-16 · 18 min read #inference#quantization#sparsity#dataflow#gpuGroq and SambaNova — Chips That Went All In on Inference ♪ Listenable
A deep look at the working principles of two chips that bet everything on inference rather than training: the Groq LPU and the SambaNova RDU. We cover how deterministic execution and compiler scheduling, plus reconfigura
2026-06-16 · 19 min read #groq#sambanova#inference#ai-hardware#lpu