iSDFT: Information-Proximal Self-Distillation for Continual Learning in LLMs.

arXiv:2609.24646v2 Announce Type: replace-cross Abstract: On-policy self-distillation fine-tuning (SDFT) learns new skills from demonstrations while reducing forgetting, but it always distils toward the full demonstration-conditioned teacher. This fixes teache