On-Policy Self-Training: Data-Free Self-Improvement in Large Language Models.

arXiv:2610.32770v1 Announce Type: cross Abstract: On-policy self-distillation enables post-training foundation models without relying on stronger external teachers. However, existing approaches rely on ground-truth question-answer pairs, human-curated problem