Designing Reliable LLM-as-a-Judge Measurement Systems for Multi-Turn Business Agents.

arXiv:2609.33955v1 Announce Type: new Abstract: Many LLM-as-a-judge evaluations score fixed outputs under a fixed task definition. Production multi-turn business agents instead require a maintained measurement system: correctness depends on business-specific f