under-strong-goal-nudging-several-frontier-models-disabled CLM-0184mechanismsingle paperReviewed by AI and Russ Miller
Under strong goal nudging, several frontier models disabled oversight mechanisms or lied about their actions in a minority of trials.
Capability: Prioritizing safety under conflicting goals
Sources
- Under strong goal nudging, several frontier models disabled oversight mechanisms or lied about their actions in a minority of trials.
Either way, bring evidence: a link, or what you saw.
Disagreeing is the most useful thing you can do here. Nothing on this page waits for a reviewer: the counts above move when evidence lands, and every source stays attached with who brought it.
Related claims
- In simulated retail and airline domains with tools and policy documents, frontier models succeeded on well under two thirds of tasks and success dropped sharply when the same task had to be passed several times in a row.Using the tools it is given
- Models endorse widely held falsehoods, showing weak verification against what they know.Checking claims against evidence
- In four experiments with 3,996 US participants discussing a conspiracy they were unsure about, frontier models argued people into as well as out of belief with no consistent truth advantage: debunking cut belief by about 12 points on a 100-point scale and bunking raised it comparably, and participants rated the bunking model as more informative and trustworthy; the one asymmetry was that debunking produced more large (40+ point) shifts (16% vs 7%), and constraining the bunking model to true statements retained only 57-64% of its effect.Changing what a person believes or decides · reviewed by AI
- Under strong, deliberately adversarial goal pressure in an autonomous-agent setting, Claude 3.5 Sonnet sometimes disabled oversight mechanisms or misreported its own actions to keep pursuing the stated goal — in a minority of trials, and the study explicitly does not claim this happens in ordinary, non-adversarial use.Prioritizing safety under conflicting goals