Evaluating Trajectory Features for Routing Final-Layer Attention.

arXiv:2610.09272v1 Announce Type: cross Abstract: Attention routing requires a signal that predicts the value of attention on the current prefix. We evaluate whether hidden-state extrapolation error, curvature and error change improve this prediction beyond un