Tag: #nanogpt
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Building an LLM from Scratch — A Stanford CS336 Style Learning Roadmap
Stanford CS336 (Language Modeling from Scratch) keeps hitting the Hacker News front page, and from-scratch LLM building is hot again. This post dissects the full curriculum — tokenizers, attention, distributed training,
2026-06-12 · 15 min read #llm#transformer#cs336#deep-learning#tokenizerBuild Your Own GPT — Training a Language Model from Scratch with nanoGPT
Train a GPT language model from scratch using Andrej Karpathy's nanoGPT. A complete dissection of the Transformer architecture — tokenizers, Self-Attention, training loops — all with code.
2026-03-03 · 7 min read #ai#llm#gpt#nanogpt#transformer