long-form-biographies-from-strong-models-contain-substantial-sharemechanismsingle paper
Long-form biographies from strong models contain a substantial share of unsupported atomic facts, rising for less well-known subjects.
Capability: Stating false facts confidently
Sources
- Long-form biographies from strong models contain a substantial share of unsupported atomic facts, rising for less well-known subjects.
Disagreeing is the most useful thing you can do here. Both sides of every contested claim in this catalog were assembled by the same person, which is its weakest point.
Related claims
- Models endorse widely held falsehoods, showing weak verification against what they know.Checking claims against evidence
- Decomposing long answers into atomic facts and checking each with search catches most errors and beats human annotators on cost and agreement.Stating false facts confidently
- Accuracy on a fact scales with how many pretraining documents mention it, so long-tail facts are systematically unreliable.Stating false facts confidently
- On verifiable instructions such as length and format constraints, strong models still fail a meaningful share, and failures grow when several constraints apply at once.Following an unfamiliar procedure