Before Attention Sinks Form: Hidden-State Geometry Reveals and Modulates Their Formation.

arXiv:2610.16745v1 Announce Type: cross Abstract: Attention sinks are usually studied after they have formed. We ask whether a measurable hidden-state change appears beforehand and whether changing that geometry alters what happens later. To remove network dep