Opening LLM Judges: Recovering Preference Signals Beyond the Final Verdict.

arXiv:2609.32407v1 Announce Type: new Abstract: LLM judges are widely used to evaluate model outputs, but their verdicts can be unreliable: a judge may favor the worse answer for its position, length, or other surface features. When a judge is wrong, is the in