Switching Linear Attention.
arXiv:2609.39034v1 Announce Type: cross Abstract: Designing expressive sequence layers with efficient inference remains a central challenge in modern machine learning. Standard softmax attention achieves excellent sequence modeling performance through rich non
arXiv cs.AIResearch source·