RealSWE: A Compositional Evaluation of Coding Agents under Realistic User Requests.

arXiv:2608.27831v3 Announce Type: replace Abstract: Coding agents are now commonly evaluated on the SWE-bench family of benchmarks, whose tasks are built from curated GitHub issues: long, structured, and information-rich. Real user requests, however, are typic