Encoder-Decoder Transformers: Logical Characterizations and Periodicity.

arXiv:2605.07705v2 Announce Type: replace-cross Abstract: We give logical characterizations of encoder-decoder transformers, the foundational architecture for LLMs that also sees use in various settings that benefit from cross-attention, in the practical setti