Base Models Can Reason By Taking a Cue From Training Data.

arXiv:2610.06851v1 Announce Type: cross Abstract: In this paper, we study how training data creates associations between the tokens at the start of a base model's response and the reasoning behavior that follows. First, we demonstrate that fixing particular st