ORCA-bench: How Ready Are Language Model Agents for Oncall?

arXiv:2607.28545v3 Announce Type: replace-cross Abstract: Large language models can write, patch, and search code, but oncall root cause analysis (RCA) demands something different: reasoning over noisy metrics, logs, traces, and source code, starting from ambi