Skip to content
Research

CoWindow Attention: Full Causal Coverage Is a Collective Property.

arXiv:2609.32704v1 Announce Type: new Abstract: FullAttn repeatedly exposes the complete causal history to every attention head, creating substantial redundant computation and memory traffic even with IO-efficient dense kernels. We introduce CoWA, a structured

arXiv cs.AIResearch source·