Benchmarking Code LLM-as-a-Judge via Constrained Perturbation and Calibration.

arXiv:2512.20159v2 Announce Type: replace-cross Abstract: Code from LLM-assisted development may contain defects like API hallucinations, motivating the development of code evaluation metrics to assess such code before deployment. As conventional rule-based me