Opinion Leader Dynamics: How Sparse Attention Shapes Token Clustering.

arXiv:2609.24202v1 Announce Type: cross Abstract: Sparse attention reduces the quadratic cost of global self-attention while retaining strong empirical performance, but how its restricted interactions shape the evolution of token representations remains theore