From Normative Frameworks to Alignment Data: Constructing and Evaluating SFT and Preference Data.

arXiv:2609.35201v1 Announce Type: cross Abstract: Aligning language models with a specified normative framework requires translating abstract principles into concrete examples and preference signals from which models can learn. We present an expert-driven meth