arxiv-2609-09696 SRC-0232 · paper

When Auditors Fabricate: Batch-Size Degradation and Confident Hallucination in LLM Detection of Planted Document Contamination

Karan Parekh, Sanjana Pendyala Ravinder, Sana Mhapsekar, Medina Maloku

Created: 2026-09-09 · Ingested: 2026-09-19

https://arxiv.org/abs/2609.09696(opens in a new tab)

Large language models are increasingly proposed as automated auditors of document quality, yet their reliability as detectors of planted errors is poorly characterised. We construct a contaminated corpus of 150 academic papers spanning supply chain management and medical research, injecting 450 known contaminants of three types: typographical corruption, semantic reversal, and absurd out-of-context insertion. We then evaluate Google Gemini 3.0 Pro's ability to recover a 180-contaminant answer-key subset across 60 documents under three prompting regimes of increasing scale: single document, sma

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.