Language models recognize dropout and Gaussian noise applied to their activations.

arXiv:2604.17465v3 Announce Type: replace Abstract: We provide evidence that language models can detect, localize and, to a degree, verbalize the difference between a-semantic perturbations applied to their activations. More precisely, we either (a) apply drop