Skip to content
Research

Memory as a cache: Exact context reuse and deletion by construction.

arXiv:2609.32395v1 Announce Type: new Abstract: The KV cache of a transformer entangles every token's representation with its entire prefix: a passage encoded once cannot be reused under a different prefix or removed without recomputing everything after it, so

arXiv cs.AIResearch source·