Bidirectional Preference Synthesis: Learning Prompt-Conditioned Preferences from Boundary Failures.

arXiv:2610.04328v1 Announce Type: new Abstract: Correction-based offline preference pipelines commonly treat model failures only as rejected responses under the original prompt. This supervision is incomplete for boundary failures: responses that violate the g