SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis Models.

arXiv:2610.28767v1 Announce Type: cross Abstract: Current evaluation of LLMs on benchmarks typically aggregates performance over individual examples into a single scalar score. This approach is overly coarse and ignores the diverse scope of skills covered by b