Skip to content
Research

SparseGDN: Chunk Sparse in Linear Attention.

arXiv:2610.41420v1 Announce Type: cross Abstract: Gated Delta Networks (GDNs) offer linear-time sequence modeling, yet long-context prefill remains costly due to dense intra-chunk computation, recurrent-state updates, and intermediate state storage. We introdu

arXiv cs.AIResearch source·