RAQ-MLA: Role-Aware Quantization for Multi-Head Latent Attention Caches.

arXiv:2610.33625v1 Announce Type: new Abstract: Multi-Head Latent Attention (MLA) has been adopted by recent frontier large language models. Instead of per-head keys and values, MLA caches a compressed KV latent that is up-projected into keys and values at dec