Tag: #온도
Kubernetes, DevOps and MLOps, written from things we ran and measured ourselves · 1 posts
Knowledge Distillation: Transferring What a Large Model Knows to a Small Model — Plus "Recorded Teacher → Real-Time Student"
Knowledge distillation is a training method where the outputs of a large model (the teacher) are used as the targets for a small model (the student). We examine Hinton et al.'s (2015) idea that teacher probabilities soft
2026-10-17 · 17 min read #비전 모델#지식 증류#온도#DeiT#Noisy Student