Disentangling Self-Distillation: Measuring and Modeling Acquisition and Retention.

arXiv:2609.39494v1 Announce Type: new Abstract: Self-distillation with privileged context adapts a language model from demonstrations by letting the model, once conditioned on a reference response, teach its context-free copy token by token. Our taxonomy revea