From Self-Distillation to Self-Practice: Privileged Information for Multi-Turn Agents.

arXiv:2609.29051v2 Announce Type: replace Abstract: On-policy self-distillation (OPSD) has become a popular recipe for post-training LLM agents. It supervises the agent model at the token level with a stronger teacher view of the same model, obtained by condit