Do Agent Benchmarks Do What They Say? An Executable-Contract Audit of Tool-Using Agent Environments.

arXiv:2609.37315v1 Announce Type: cross Abstract: Tool-using agents are entering settings where a wrong action carries real cost, and the benchmarks certifying them grade what each simulated tool call reports having done, assuming the tool did what its interfa