Concerns in Benchmarking Jailbreaks: An Empirical Study of Attack Success Rates.

arXiv:2610.26595v1 Announce Type: cross Abstract: Jailbreak methods are commonly compared using Attack Success Rate (ASR), but these comparisons depend on how responses are generated and judged. In this paper, we examine eight attacks against three open-weight