The Geometry of Learning: Read-Write Asymmetry Across Training.
arXiv:2605.16600v2 Announce Type: replace-cross Abstract: Pretraining and alignment update the same transformer weights, and we ask in which directions each stage changes them. The residual stream gives every matrix a shared coordinate system, in which a weigh
arXiv cs.AIResearch source·