The Extender: A Log-Structured Transformer.

arXiv:2609.32759v1 Announce Type: cross Abstract: We introduce the Extender, a log-structured variant of the standard Transformer architecture. In a standard Transformer, each layer communicates with subsequent layers exclusively via the residual $\mathbf{h}$,