Skip to content
Research

Good Evals Are Hard: An ImpossibleBench Audit.

LessWrongAnalysis or commentary·
AI brief

The author ran the LiveCodeBench portion of ImpossibleBench, a benchmark measuring reward hacking in LLM coding agents, against frontier models current as of October 2026.

Why it matters: Benchmarks used to detect reward hacking in coding agents may not hold up when re-run on newer frontier models.

Written by AI from LessWrong's published text.

Source

“(This post is a summary. See GitHub Repo for details .) Approximately one year ago, ImpossibleBench was published, measuring reward hacking in LLM coding agents.”
LessWrong, 12 Oct 2026, 22:39.

Interpretation or community commentary rather than straight reporting.

Read original story ↗