Do Not Trust the Benchmark: Limitations of General LLM Rankings and a Case for Task-Specific Evaluation.

arXiv:2609.23201v1 Announce Type: new Abstract: Benchmark scores increasingly influence the development, marketing, and selection of large language models (LLMs). Yet an overall score is interpretable only in relation to the system tested, the questions includ