Who Should We Listen to More? Welfare-Aware Preference Acquisition for Pluralistic Alignment.

arXiv:2610.19035v1 Announce Type: cross Abstract: Pluralistic alignment needs to accommodate diverse preferences under limited human feedback. Using AI simulators to label preference comparisons reduces annotation costs, but variation in simulation accuracy ac