On the Statistical Mechanics of Attention.

arXiv:2610.17347v1 Announce Type: cross Abstract: We revisit the statistical mechanics of Transformer attention via modern Hopfield models. We present a free-energy formalism to characterize parameter regimes and critical thresholds for robust attention infere