PADM\'E: Preference Alignment Data Synthesis for Meta-Evaluation of LM Agent Evaluators.

arXiv:2609.36086v1 Announce Type: cross Abstract: Language models are frequently employed to evaluate other language models. An LM evaluator scoring agentic behaviors across multiple criteria is valuable, provided that its decisions align with human judgment.