Tag: #self-attention
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Dissecting the Transformer — From Attention to KV Cache
A from-scratch breakdown of the Transformer: self-attention, multi-head, positional encoding, the FFN, and residual connections with normalization. It connects tensor shapes and parameter counts, causal masking, encoder/
2026-06-26 · 16 min read #llm#transformer#attention#positional-encoding#kv-cacheVision Transformer (ViT) Paper In-Depth Analysis: An Image is Worth 16x16 Words ♪ Listenable
An in-depth analysis of Google ViT paper. We cover the innovative approach of converting images into patch sequences, the principles behind Patch Embedding and Position Embedding, the performance vs. data efficiency trad
2026-03-01 · 30 min read #vit#vision-transformer#computer-vision#transformer#image-classification