Learning Style, Forgetting Semantics: A Case Study of SFT and RFT on Classification Tasks.

arXiv:2610.02437v1 Announce Type: cross Abstract: Why does supervised fine-tuning (SFT) lead to more forgetting than reinforcement fine-tuning (RFT), even when all teacher demonstrations are semantically correct? We study this question on classification tasks