training-free-inference-time-hallucination-mitigation-7b-vision-language-models-reported-gainsFor training-free inference-time hallucination mitigation in 7B vision- language models, reported gains on object-hallucination benchmarks are largely inseparable from reduced informativeness: hallucination rate and object recall/coverage move together, so a lower score can mean the model mentioned fewer visual entities rather than grounded better.
Ingested from a paper but not yet reviewed by a human. It is deliberately inert: it does not move any technique’s standing, does not count toward the backtest, and is excluded anywhere a claim would carry weight. Read the source before relying on it.
Capability: Whether the measurement made the finding
Observed on
Six decoding-time and attention/hidden-state mitigation methods on three 7B open LVLMs (LLaVA-1.5, LLaVA-NeXT, InstructBLIP), evaluated on CHAIR, AMBER, and MMStar with author-defa.
Sources
- supportsDoes Playing it Safe Count as Faithfulness? Reassessing LVLM Hallucination Mitigation Methods54 configurations (3 models x 6 methods x 3 benchmarks). Reports Pearson r=0.73 between CHAIRs and object recall, r=0.70 between AMBER Hal and Cover, over the method set. Correlation is across methods, not within a method under varied strength, so it does not isolate a causal mechanism; the authors say so. Two methods (CAAC, CEI) reportedly preserved recall, so the pattern is a tendency, not universal. On MMStar, 16 of 18 fine-grained-perception configurations degraded or gained under 1%.
Disagreeing is the most useful thing you can do here. Both sides of every contested claim in this catalog were assembled by the same person, which is its weakest point.
Related claims
- For training-free inference-time hallucination interventions in 7B-class vision-language models, increasing intervention strength (finer regional evidence partitioning, longer attention-routing windows, stronger textual perturbation) keeps lowering CHAIR object-hallucination scores while producing empty or reduced-coverage responses, so lower hallucination numbers at high intervention strength partly reflect the model saying less rather than grounding better.Grounding answers in the image · unreviewed
- In open-source vision-language models (LLaVA-1.5, Qwen-VL-Chat, Qwen2.5-VL, LLaVA-NeXT), a training-free decoding intervention that detects large layer-to-layer and step-to-step shifts in hidden states and nudges the diverging states back toward their prior value lowers object-hallucination rates, but the lower rate comes with fewer objects mentioned and shorter outputs.Grounding answers in the image · unreviewed
- In 7-8B vision-language models, fine-tuning visual and text embeddings toward perturbation-averaged and ground-truth anchors before cross-modal contrastive alignment lowers object and attribute hallucination rates on captioning and existence benchmarks without reducing object coverage or general VQA accuracy.Grounding answers in the image · unreviewed
- A ~2M-parameter classifier head that reads hidden states already computed during generation (tapping shallow, middle and deep layers of the generating model) detects response-level hallucination at least as well as specialized hidden-state hallucination detectors, and its detection quality rises with the scale of the base model it is attached to.Stating false facts confidently · unreviewed
- For short-answer object-existence questions in open multimodal models (LLaVA v1.5, MiniGPT-4, Qwen2.5-VL), object hallucination is driven partly by the visual encoder itself rather than only by language priors: hallucinated cases show lower image-text embedding similarity and inverted attention, and swapping in a weaker or noisier visual encoder lowers POPE accuracy while a stronger one raises it.Grounding answers in the image · unreviewed
Notes
Ingested unreviewed on 2026-09-07 and deliberately inert until a human endorses it: it does not move a technique standing, does not count toward the backtest, and is excluded anywhere a claim would carry weight. Drafted confidence: medium. Falsifier as drafted: A mitigation method that lowers CHAIR/AMBER hallucination while holding or raising object recall and coverage, and does not degrade MMStar fine-grained perception and reasoning, across several models. Automatic check flagged: figures not in the source: 16. Proposed technique, not yet catalogued: Score hallucination jointly with informativeness and general capability.