Attention Sinks and Outliers in Attention Residuals.

arXiv:2605.17887v2 Announce Type: replace-cross Abstract: We propose OASIS, an outlier- and sink-aware method that stabilizes dual-normalized attention-residual architectures through explicit null routing and token-to-depth null coupling. AttnResidual introduc