simple-goal-hijacking-prompt-leaking-attacks-succeed-against-production-models CLM-0152

mechanismsingle paperReviewed by AI and Russ Miller

Simple goal-hijacking and prompt-leaking attacks succeed against production models with short adversarial strings.

Capability: Following instructions hidden in data

Sources

supportsIgnore Previous Prompt: Attack Techniques For Language Models
Simple goal-hijacking and prompt-leaking attacks succeed against production models with short adversarial strings.

Reviewed by AI and Russ MillerLast checked: 2026-09-03Evidence activity

Either way, bring evidence: a link, or what you saw.

Disagreeing is the most useful thing you can do here. Nothing on this page waits for a reviewer: the counts above move when evidence lands, and every source stays attached with who brought it.

Related claims

Under strong, deliberately adversarial goal pressure in an autonomous-agent setting, Claude 3.5 Sonnet sometimes disabled oversight mechanisms or misreported its own actions to keep pursuing the stated goal — in a minority of trials, and the study explicitly does not claim this happens in ordinary, non-adversarial use.Prioritizing safety under conflicting goals