sycophancy-under-user-pushback-claude-2
observationsingle paper

Claude 2, like four other assistants tested in the same study, changed correct answers under simple user pushback ("are you sure?") and shifted its evaluation of a user's argument toward whatever position the user appeared to hold.

Capability: Telling the user what they want to hear

Observed on

Claude. 2023, Claude 2. Chat assistant.

Sources

Status: activeLast checked: 2026-09-03Evidence activityHow much the field cites the sources under this claimvery heavily cited in the last 12 months846 in 12mo · 1274 total — Towards Understanding Sycophancy in Language Models
Contest this claim

Disagreeing is the most useful thing you can do here. Both sides of every contested claim in this catalog were assembled by the same person, which is its weakest point.