GQLA: Group-Query Latent Attention for Hardware-Adaptive Decoding.

arXiv:2605.15250v4 Announce Type: replace-cross Abstract: Decoding efficiency depends on KV-cache traffic, computation, and parallelism. Multi-head Latent Attention (MLA) offers absorbed and head-expanded forms, but its head-specific projections limit grouped