Memory as a cache: Exact context reuse and deletion by construction.
arXiv:2609.32395v1 Announce Type: new Abstract: The KV cache of a transformer entangles every token's representation with its entire prefix: a passage encoded once cannot be reused under a different prefix or removed without recomputing everything after it, so
arXiv cs.AIResearch source·