arxiv-2609-11154 SRC-0279 · paper

Multi-Faceted Evaluation and Mitigation of Emotion Hallucinations in MLLMs

Bowen Zeng, Peipei Song, Weidong Chen, Shengeng Tang, Song Ye, Yuanhong Zhong

Created: 2026-09-10 · Ingested: 2026-09-19

Multimodal large language models (MLLMs) have shown strong potential in open-ended emotion understanding, yet they often generate emotion hallucinations. Evaluating such hallucinations is particularly challenging for two reasons. First, emotion understanding spans multiple cognitive facets, from multimodal perception to psychological reasoning. Second, emotional interpretations are expressed in free-form language, making existing closed-ended protocols insufficient for evaluation. To address these challenges, we introduce EHR (Emotion Hallucination Rate), an evaluator that quantifies emotion h

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

supportsFor open-ended emotion interpretation by multimodal LLMs, coarse-grained hallucination mitigations designed for object hallucination (VCD, ICD, M3ID) and self-verification (EmotionHallucer) cut unsupported claims in some facets while raising them in others — e.g. lowering audio hallucination but increasing expression and action hallucination — so a single aggregate hallucination rate hides the trade-off.