Off-Policy Merging Beats On-Policy Self-Distillation for Continual Learning.

arXiv:2610.05872v1 Announce Type: cross Abstract: A long-standing goal of AI is a model that can continually learn and improve itself. On post-trained models, supervised finetuning (SFT) on new data often causes poor generalization and catastrophic forgetting.