CD-OPD: Contextual Digest for On-Policy Distillation.

arXiv:2610.25359v1 Announce Type: cross Abstract: Teacher takeover in on-policy distillation (OPD) can produce incorrect responses even when the student and teacher independently answer the same problem correctly, a failure we quantify using Collaboration Fail