Multi-Head Latent Attention (MLA) enables expressive multi-head attention with compact caches for its content and decoupled RoPE paths, yet cache memory still scales linearly with context length and batch size.
← Back to all developments · Signals are a development reported by more than one source. See the methodology.