Not Every Divergence Should Be Suppressed: Counterfactual Recoverability in On-Policy Distillation.

arXiv:2608.04408v3 Announce Type: replace-cross Abstract: On-policy distillation (OPD) supervises student-visited trajectories, yet divergence-based rules cannot determine whether an erroneous prefix remains correctable. We formulate this decision as counterfa