Emergence of the transformer architecture as the score of entropic laws of random measures.

arXiv:2610.39614v1 Announce Type: new Abstract: We show that the transformer architecture emerges as the score of last-token laws in a natural statistical model of language, where sentences are empirical measures of tokens, a language is a law on $P(S^d)$, and