Partition the Support, Reconstruct the Residual: Training-Free Sparse Attention for Video Generation and World Models.

arXiv:2608.18484v2 Announce Type: replace-cross Abstract: Block-sparse attention accelerates video transformers by grouping queries and keys and computing attention only between selected groups. However, it faces two challenges: (1) queries sharing a block rou