Task Success Is Not Enough: Side-effect-Aware Evaluation of Tool-Using Language Model Agents.

arXiv:2610.34167v1 Announce Type: new Abstract: Tool-using language model agents are usually evaluated by whether they finish the user's task. That metric misses a common failure: an agent can complete the requested work while also taking an unauthorized side-