Tag: #gpu-kernel
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
What It Really Means to Hand-Tune a GPU Kernel — Making One Transpose Kernel 5x Faster ♪ Listenable
Starting from threads, warps, and the memory hierarchy, this post covers what it actually means to hand-modify a GPU kernel. It explains why occupancy is a symptom rather than a goal, and why most kernels are bound by me
2026-08-02 · 19 min read #cuda#gpu-kernel#nsight-compute#memory-bandwidth#performanceThree Layers of Writing a Kernel — Comparing CUDA C++, Triton, and CUTLASS on the Same Problem
Compares what changes when you approach the same GPU kernel by hand in CUDA C++, tile-by-tile in Python with Triton, or assembled from templates in CUTLASS and CuTe. We actually write a row-wise softmax in both CUDA C++
2026-08-02 · 18 min read #triton#cuda#cutlass#gpu-kernel#compiler