Continually Post-training Small Models via Synthetic Self-distillation.

arXiv:2610.13113v1 Announce Type: cross Abstract: Continual post-training faces a dual challenge of acquisition and retention: models must learn new capabilities while preserving prior knowledge. While Self-Distillation Fine-Tuning (SDFT) mitigates this using