Subquadratic Attention with a Hierarchical Tree-Structured Indexer.

arXiv:2610.42112v1 Announce Type: cross Abstract: The quadratic scaling of attention is a fundamental bottleneck limiting the long-context capabilities of large language models (LLMs). A variety of approaches have attempted to circumvent this, but they either