Stochastic Teacher Intervention for Agentic On-Policy Distillation.

arXiv:2610.10878v1 Announce Type: cross Abstract: On-policy distillation (OPD) efficiently transfers capabilities from a stronger teacher to a student language model through dense token-level supervision on student-generated rollouts and has shown promise on c