Cross-Model In-Context Neurofeedback Reveals (Limited) Activation Control in LLMs.

arXiv:2610.20179v2 Announce Type: replace-cross Abstract: Probes on activation vectors are widely used to detect misbehavior in language models, but their success relies on the assumption that models cannot control what their activations encode. Humans can lea