SWE-DIVE: Multi-Turn Coding Agent Evaluation with Dynamic User Simulation.

arXiv:2610.30047v1 Announce Type: cross Abstract: Coding agents are typically evaluated using one-shot, well-formulated prompts. Benchmarks such as SWE-bench use existing GitHub issues as input for a coding agent and evaluate whether the agent successfully sol