general-purpose-factuality-verifiers-entailment-consistency-rag CLM-0061General-purpose factuality verifiers (entailment-, consistency-, and RAG-trained) and zero-shot frontier LLM judges perform near chance at spotting unsupported claims in scientific peer reviews that must be checked against the full submitted paper, because they cannot separate paper-unsupported assertions from legitimate evaluative critique; small models fine-tuned on in-domain examples beat them by a wide margin.
Evidence for: Brandolini's law (holds)
Capability: Stating false facts confidently
Observed on
Peer reviews of ML conference papers (ICLR/NeurIPS on OpenReview) with synthetically injected hallucinations; detection at review and sentence level with BM25 or full-paper evidenc.
Sources
- supportsHalluPeer: A Taxonomy-driven Benchmark for Detecting Hallucinations in Scientific Peer ReviewsMeasured on 12K papers and 38K reviews; four specialized verifiers gave review-level MCC of at most 0.03, prompted LLMs including GPT-5.2 stayed at 0.15-0.25 review-level MCC, while a fine-tuned Qwen2.5-3B reached 0.69 and Qwen3-32B 0.81. Hallucinations are LLM-injected rather than naturally occurring, so difficulty may reflect the injection distribution; a small authentic-review check (20 annotated cases) showed the fine-tuned detector recovered all of them at 22% false positive rate.
Disagreeing is the most useful thing you can do here. Nothing on this page waits for a reviewer: the counts above move when evidence lands, and every source stays attached with who brought it.
Related claims
- General-purpose factuality verifiers (entailment-, consistency-, and RAG-trained) and zero-shot frontier LLM judges perform near chance at spotting unsupported claims in scientific peer reviews that must be checked against the full submitted paper, because they cannot separate paper-unsupported assertions from legitimate evaluative critique; small models fine-tuned on in-domain examples beat them by a wide margin.Stating false facts confidently · reviewed by AI
- When LLM-generated peer reviews are compared with human reviews point by point under theory-guided critique frameworks, the model and human critique differ in kind rather than in quality: LLM reviews carry more explanatory depth, integrative reasoning and explicit argument structure, while human reviews more often identify higher-order weaknesses and give revision-oriented guidance, and an expert prompt does not close that gap but amplifies the LLM-side tendencies.Judging another's work as well as a careful reviewer would · reviewed by AI
- In LLM fact-checking over supplied evidence, high veracity accuracy does not imply the verdict depends on that evidence: when the model's own cited sentences are iteratively removed, off-the-shelf models (GPT-4o-mini, Gemini-2.5-Flash-Lite, Qwen-2.5-32B, Llama-3.1-8B) keep their SUPPORT/REFUTE labels at a non-zero plateau instead of abstaining, and training with paired supervision that requires NOT_ENOUGH_INFO on the evidence-ablated input removes most of that persistence without losing accuracy.Checking claims against evidence · reviewed by AI
- Used zero-shot as step-level action critics in long-horizon tool-calling tasks, frontier models are over-pessimistic — flagging a large share of correct actions and pushing the actor into revision loops that lower success below no critic at all — whereas small models fine-tuned on action-level verification rationales flag far fewer valid actions and raise repeated-run reliability.Using the tools it is given · reviewed by AI
- When an 8B model verifies natural-language claims against knowledge-graph triples, scoring the evidence twice under opposing prompts (argue it supports, argue it refutes) and adjudicating between the two arguments avoids the bias toward a "Supported" verdict that a single-perspective assessment shows, and is the largest single contributor to accuracy in that pipeline.Checking claims against evidence · reviewed by AI
Notes
Drafted from the paper by a model and filed unreviewed. Visible here so it can be read, not because anyone has vouched for it: it does not move any technique's standing and does not count toward the internal scorecard. Drafted confidence: medium. Falsifier as drafted: An off-the-shelf verifier or zero-shot frontier LLM reaching review-level MCC comparable to the in-domain fine-tuned models on this or a similar peer-review grounding benchmark. Proposed technique, not catalogued: Taxonomy-driven hallucination injection for review verification benchmarks.