Will the Judge Flip? Predicting Position-Sensitive LLM Judgments from Residual Stream Activations.

arXiv:2610.07115v1 Announce Type: cross Abstract: The order in which candidate responses are presented can change an LLM judge's verdict. Detecting such a position flip ordinarily requires judging each pair in both orders, which doubles the number of judgments