arxiv-2605-10843 SRC-0357 · paperTraining-Free Cultural Alignment of Large Language Models via Persona Disagreement
Created: 2026-05-11 · Ingested: 2026-09-19
https://arxiv.org/abs/2605.10843(opens in a new tab)Large language models increasingly mediate decisions that turn on moral judgement, yet a growing body of evidence shows that their implicit preferences are not culturally neutral. Existing cultural alignment methods either require per-country preference data and fine-tuning budgets or assume white-box access to model internals that commercial APIs do not expose. In this work, we focus on this realistic black-box, public-data-only regime and observe that within-country sociodemographic disagreement, not consensus, is the primary steering signal. We introduce DISCA (Disagreement-Informed Steerin
In brief
Disagreement between culturally grounded personas, not their consensus, carries the usable signal for steering a model's moral preferences at inference time. DISCA instantiates each country as a panel of 4 World-Values-Survey-grounded persona agents, converts the panel's logit-gap variance into a bounded loss-averse correction via prospect-theory importance sampling, and shrinks the correction when 2 independent half-budget passes disagree. No weight updates, no per-country reward models, only decision-token logprobs.
On the MultiTP trolley benchmark across 20 countries and 7 open-weight backbones (2B-70B, 5 families), macro misalignment (L2 distance to human AMCE vectors) drops 10-24% on the 6 backbones at or above 3.8B, 3.4% on the 2B Gemma, and 2-7% on open-ended scenarios. Phi-4 (14B) with DISCA reaches 0.346 MIS, below vanilla Llama-3.3-70B. On the Phi-4 grid DISCA beats all training-free baselines (PRISM prompt 0.384, activation steering 0.430, vanilla 0.454) and 2 oracle baselines fit on human AMCEs (0.506, 0.513).
Evidence is measured, with a 4-component ablation on 3 backbones (removing personas costs the most, +.047 to +.061 MIS, hurting 16-18 of 20 countries), 3 seeds, and compute matched between the dual-pass gate and a single full pass. Alignment target is a crowdsourced survey statistic, not legitimacy. The effect does not transfer to factual cultural QA on BLEnD, and costs roughly 4x vanilla latency. Useful if you need per-country value calibration behind a logprob-exposing API.
Written from the abstract by claude-opus-5 on 2026-10-24, with every figure checked against it. Not a substitute for the paper.
Referenced by
Claims in this catalog that draw on this source, and whether as support or counterpoint.