Data-Free On-Policy Distillation: How Far Can We Go Without External Data?

arXiv:2609.14193v4 Announce Type: replace-cross Abstract: On-policy distillation (OPD) is increasingly applied to frontier foundation model post-training. Prior work in this area has largely focused on algorithmic advances, yet it remains unclear how much OPD