MassAlloc Attention: Let Attention Allocate Its Own Compute.
arXiv:2609.32712v1 Announce Type: new Abstract: FullAttn often assigns negligible normalized mass to much of the causal score space, yet dense kernels execute the complete post-score path after forming each QK tile. We introduce MALA, a fused attention primiti
arXiv cs.AIResearch source·