Spontaneous Context Restoration: How Language Models Recover from Corrupted Inputs.

arXiv:2609.35475v1 Announce Type: cross Abstract: Language models sometimes produce correct outputs even when their inputs are corrupted by deletion, replacement, or misspelling. We study the internal processes accompanying this behavior, which we call context