API Benchmark Scores Do Not Reliably Transfer to Chatbot Interfaces.

arXiv:2609.08861v3 Announce Type: replace Abstract: Benchmark scores are a central currency in model releases: they inform purchasing decisions, shape public trust, and influence policy. Yet, a key assumption underlying benchmark scores is that the model perfo