Sinkhorn doubly stochastic attention rank decay analysis.

arXiv:2604.07925v2 Announce Type: replace-cross Abstract: The self-attention mechanism is central to the success of Transformer architectures. However, standard row-stochastic attention has been shown to suffer from significant signal degradation across layers