Conditional Accuracy Profiles: Diagnosing LLM Judges across Deployment Conditions.

arXiv:2610.09229v1 Announce Type: cross Abstract: LLM-as-judge is now a standard tool for scalable evaluation, but judge performance is still often summarized by a single accuracy number. This aggregate view hides the deployment conditions under which a judge