PReMISE: Policy Rubrics as Measurement Specifications for LLM Judges.

arXiv:2605.30803v2 Announce Type: replace Abstract: LLM judges are increasingly used to evaluate open-ended responses, but their scores depend strongly on the rubrics that condition them. A vague rubric asking for a response to be ``helpful and factual'' can r