Commutator Memory: Sparse, Path-Local Reading and Steering in Language Models.
arXiv:2609.34348v1 Announce Type: cross Abstract: Gradient updates on different data generally do not commute: training a language model on two data sources in opposite orders gives different weights, even with the same data and total exposure. Loss or benchma
arXiv cs.AIResearch source·