Codoku: Renewable Program-Reasoning Challenges for Frontier Coding Agents.

arXiv:2609.34661v1 Announce Type: cross Abstract: Existing program-reasoning benchmarks ask large language models to predict a program's behavior on a given input. Coding agents break two assumptions on which these benchmarks rest: an agent can recover the ans