Is Memorization Context-Sensitive? Prefix-Based Extraction Beyond Isolated Prefixes.

arXiv:2610.12085v1 Announce Type: new Abstract: Large language models (LLMs) can expose memorized training sequences under prefix-based extraction: given a prefix from a training example, the model may assign high probability to the original continuation. In d