Tag: #sequence-modeling
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 4 posts
Mamba and State Space Models Complete Guide: Beyond Transformers ♪ Listenable
A complete guide to understanding Mamba and State Space Models (SSMs). We deeply analyze S4, H3, and Mamba 1/2 architectures that solve the quadratic complexity problem of Transformers, along with hybrid models like Mamb
2026-03-17 · 20 min read #mamba#state-space-model#ssm#deep-learning#sequence-modelingMamba and State Space Model Paper Deep Dive: Transformer Alternative Architectures from Selective SSM to Mamba-2 ♪ Listenable
A comprehensive analysis of the SSM architecture covering the optional State Space Model mechanism of the Mamba paper, the development process from S4 to Mamba-2, the pros and cons of linear time complexity compared to T
2026-03-07 · 30 min read #ai-papers#mamba#state-space-model#ssm#transformerRWKV-7 "Goose" Architecture Analysis — A Linear-Time Model Surpassing Transformers
A paper-based analysis of RWKV-7 Goose Dynamic State Evolution mechanism, TC0 barrier breakthrough, and performance comparison against Transformers. A next-generation architecture enabling constant memory + linear time i
2026-03-03 · 9 min read #ai-papers#rwkv#linear-attention#sequence-modeling#2026-03Mamba Paper Review: Going Beyond Transformers with Selective State Space Models
An in-depth review of the Mamba (Selective State Space Models) paper. Analyzing the evolution from S4 to Mamba, the Selective Scan mechanism, Hardware-Aware algorithms, and Mamba-2 State Space Duality with code examples.
2026-03-02 · 8 min read #mamba#state-space-model#ssm#transformer#linear-attention