Tag: #pre-training
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Complete Analysis of the GPT Series Papers: The Journey from GPT-1 to GPT-4, How Language Models Changed the World ♪ Listenable
A complete generation-by-generation analysis of OpenAI GPT series. From GPT-1 unsupervised pre-training, GPT-2 zero-shot learning, GPT-3 in-context learning and scaling laws, InstructGPT RLHF, to GPT-4 multimodal capabil
2026-03-01 · 36 min read #gpt#openai#language-model#transformer#pre-trainingComplete Analysis of the BERT Paper: How Bidirectional Transformers Changed the Landscape of NLP ♪ Listenable
An in-depth analysis of Google BERT paper. We cover bidirectional pre-training through Masked Language Model (MLM) and Next Sentence Prediction (NSP), fine-tuning strategies, and the core principles of the architecture t
2026-03-01 · 28 min read #bert#nlp#transformer#pre-training#fine-tuning