Efficient Benchmarking in Production: A Study of an Evolving LLM Agent.
arXiv:2609.21267v1 Announce Type: new Abstract: Production LLM agents are evaluated repeatedly as they evolve, but full agent benchmarks are costly to rerun. We study efficient recurring evaluation for a production analytics agent serving tens of thousands of
arXiv cs.AIResearch source·