Searching for "Harmful Refusal": A Psychometric Audit of an AI Safety Benchmark.

arXiv:2610.12409v1 Announce Type: new Abstract: Safety benchmarks typically report one overall score for a suite of datasets, each of which may target one or more safety-related attributes, so models with similar overall scores can have very different attribut