Skip to content
Research

MassAlloc Attention: Let Attention Allocate Its Own Compute.

arXiv:2609.32712v1 Announce Type: new Abstract: FullAttn often assigns negligible normalized mass to much of the causal score space, yet dense kernels execute the complete post-score path after forming each QK tile. We introduce MALA, a fused attention primiti

arXiv cs.AIResearch source·