Beyond Binary Labels: Diagnostic Evaluation of LLM Safety with Prompt-Level Rubrics.

arXiv:2610.29225v1 Announce Type: cross Abstract: Current LLM safety benchmarks predominantly rely on binary safe or unsafe labels, lacking explanatory depth and suffering from low consistency across automated judges. To address this, we introduce DiagSafe, a