arxiv-2608-23244 SRC-0436 · paperCredal Large Language Models for Semantic Commitment under Uncertainty
Shireen Kudukkil Manchingal, Sofiia Nikolenko, Fabio Cuzzolin
Created: 2026-08-24 · Ingested: 2026-10-17
https://arxiv.org/abs/2608.23244(opens in a new tab)Large language models (LLMs) often produce fluent but incorrect answers with unwarranted confidence. A central limitation is that standard LLMs represent uncertainty through a single predictive distribution, conflating epistemic ignorance with genuine ambiguity. We introduce Credal Large Language Models (CLLMs): an ensemble of LoRA adapters induces a credal set whose lower and upper probabilities expose the spread of plausible predictive distributions rather than collapsing to a single softmax output. From this representation we derive two complementary commitment scores. Credal Token Commitme
Referenced by
Claims in this catalog that draw on this source, and whether as support or counterpoint.
- supportsFor 7-9B instruct backbones fine-tuned with an ensemble of five LoRA adapters, deciding to answer only when one candidate's minimum probability across adapters exceeds every other candidate's maximum gives a threshold-free abstention rule whose commitment rate collapses when the supplied evidence is corrupted (CoQA 31-48% down to 4-8%), while mean-pooling the same adapters into one distribution requires a tuned threshold and still answers more corrupted prompts at matched clean coverage.
- supportsFor LoRA-ensemble credal commitment rules on 7-9B instruct backbones, the decision to commit tracks agreement among the adapters rather than whether a request should be answered: on AdvBench harmful prompts the ensembles commit more often (33-97%) and with higher lower-bound confidence than on benign Dolly instructions, because safety training makes refusal the unanimous first continuation.