How Much Can Repeated Running Buy? A Measured Variance Ceiling for LLM Code Evaluation.

arXiv:2606.00920v2 Announce Type: replace-cross Abstract: A benchmark score is a measurement whose uncertainty has two sources: an aleatoric component from stochastic decoding and an epistemic component from the finite problem set. Using 16 models on 99 recent