PeekKV: The First Content Token Already Knows Which Heads Matter.

arXiv:2610.23939v1 Announce Type: cross Abstract: The size of the KV cache grows linearly with context length, making it a major memory bottleneck in LLM serving. Motivated by recent progress in identifying the functional roles of attention heads, a growing bo