Technique where a smaller student model learns from a larger teacher’s soft targets or explanations.