Tag: #사전학습
Kubernetes, DevOps and MLOps, written from things we ran and measured ourselves · 1 posts
Trends in LLM Training Research for 2026: Optimizers, Data, Distillation, and RL
We summarize LLM training papers from the second half of 2026 by category. In pretraining, the Muon family is becoming the default optimizer, a scaling law was published showing that web data's AI text proportion exceeds
2026-10-31 · 14 min read #LLM 학습#사전학습#데이터 큐레이션#지식 증류#강화학습