Distinguishing Performance From Competence in Evaluations of Humanlike Abstract Reasoning.

arXiv:2510.02125v5 Announce Type: replace Abstract: AI reasoning models have exceeded human performance on the ARC-AGI-1 benchmark, but does that mean state-of-the-art models have the underlying competence (humanlike abstract reasoning) that the benchmark was