Tag: #parameter-count
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
Anatomy of config.json — Reading a Model From One Settings File
How every field in config.json — hiddensize, numhiddenlayers, numattentionheads versus numkeyvalueheads, headdim, intermediatesize, ropetheta, vocabsize, tiewordembeddings — shows up in memory and speed, and a hand count
2026-08-12 · 6 min read #ai-papers#model-internals#config-json#transformer#llm-architecture