Self-Improvement with Auxiliary Rewards: Learning from Verified Traces and Evaluating Transfer.

arXiv:2610.41296v1 Announce Type: new Abstract: Answer-level rewards cannot distinguish reasoning traces with equally correct outcomes. We study whether auxiliary trajectory preferences improve small-language-model self-improvement and transfer under limited s