Research

A, B, C, or Stable? Accuracy and Order Sensitivity Diverge in LLM Multiple-Choice Evaluation

Single source1 source14 Oct 2026

arXiv:2608.11947v2 Announce Type: replace-cross Abstract: Multiple-choice question (MCQ) benchmarks are widely used to evaluate large language models, yet a single reported accuracy number is not enough to distinguish a model's latent ability from order sensit

Reported by 1 source

arxiv.orghttps://arxiv.org/abs/2608.11947

← Back to all developments · Signals are a development reported by more than one source. See the methodology.