CoWindow Attention: Full Causal Coverage Is a Collective Property.
arXiv:2609.32704v1 Announce Type: new Abstract: FullAttn repeatedly exposes the complete causal history to every attention head, creating substantial redundant computation and memory traffic even with IO-efficient dense kernels. We introduce CoWA, a structured
arXiv cs.AIResearch source·