UtilityBench: Measuring Language Model Utility When Errors Have Different Costs.

arXiv:2610.25924v1 Announce Type: cross Abstract: As language models are increasingly deployed in real-world scenarios with important outcomes, the impact of their mistakes often extends far beyond what correctness can capture. In domains like medicine, a sing