Research & academia
Scaling Properties of Same-Family On-Policy Distillation
Examines how on-policy distillation transfers reasoning capability between model scales; the authors report that teacher size and quality interact in the tested families.
Why it matters: The relative quality and size of a teacher can shape distillation outcomes.