PRISM: Calibrating Black-Box Judges with Counterfactual Probes.

arXiv:2610.18389v1 Announce Type: cross Abstract: Large language models are increasingly used as judges to reduce reliance on costly human evaluation, yet their scores can systematically disagree with human judgments. We ask whether responses to an explicitly