arxiv-2609-11878 SRC-0285 · paper

Domain-Specific Hallucination Detection in Large Language Models

Varun Teja Chundru, Debasmita Biswas

Created: 2026-09-10 · Ingested: 2026-09-19

https://arxiv.org/abs/2609.11878(opens in a new tab)

Large language models generate fluent text that can contain unfaithful claims -- a phenomenon known as hallucination. We present a multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo (MC) Dropout uncertainty quantification, and temperature-scaled calibration for response-level hallucination detection. Evaluated on the HaluEval benchmark, our pipeline achieves F1=0.915 and AUROC=0.977 on general-domain tasks, with per-task F1 scores of 0.97 (QA), 0.96 (Summarization), and 0.82 (Dialogue). MC Dropout inference further improves accuracy to 93.2%. A context

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.