AI Alignment From Social Choice Perspectives.

arXiv:2606.21550v2 Announce Type: replace Abstract: Alignment from human feedback uses human judgments about model outputs to steer the behavior of language models after pretraining. When those judgments reflect conflicting views of desirable behavior, the lea