Skip to content
Agents

Request Order Matters: Cache-History Sensitivity in Selective KV-Cache Reuse for Rolling Agents.

arXiv:2610.05833v1 Announce Type: new Abstract: Long-running agents repeatedly call an LLM while retaining most of their document window, evicting old documents, and appending new ones. These rolling updates break exact prefix caching and motivate non-prefix K

arXiv cs.AIResearch source·