AutoSciBench: Autonomous Benchmark Generation for Evaluating Scientific Agents.

arXiv:2610.05140v1 Announce Type: new Abstract: As agents rapidly evolve, existing benchmarks can become saturated, limiting their ability to distinguish capabilities and reveal remaining failure modes. Particularly in scientific domains, constructing and upda