RubricOpt: Self-Revision of Semantic Rubrics for Preference Optimization.
arXiv:2610.29491v1 Announce Type: new Abstract: A model's failures can reveal gaps in the behavioral criteria guiding its training. We introduce RubricOpt, a framework that lets a policy revise these criteria within preference optimization. The policy diagnose
arXiv cs.AIResearch source·