VC Dimension and Expressivity of Real-Valued Transformers.

arXiv:2609.31999v1 Announce Type: cross Abstract: Whereas previous results on abilities and limitations of transformers have restricted the definition of transformers in various ways, here we study softmax-attention, multi-layer transformers operating on real