Multilinguality in Hybrid Attention LLMs.

arXiv:2609.35378v1 Announce Type: cross Abstract: In response to the growing demand for long sequences in agentic and reasoning use cases, many state-of-the-art LLMs combine multiple variants of attention to mitigate the quadratic complexity of traditional sof