arxiv-2608-21030 SRC-0429 · paperCOMET: Contrastive Motion-Enhanced Temporal Reasoning for Video Multimodal Large Language Models
Chenghua Zhu, Zhaolu Kang, Qifan Shi, Siyan Wu, Kehan Jiang, Lei Wei
Created: 2026-08-21 · Ingested: 2026-10-17
https://arxiv.org/abs/2608.21030(opens in a new tab)Video multimodal large language models have advanced significantly, yet fine-grained motion-temporal understanding remains fragile. The core bottleneck is not only sparse frame sampling, but also the lack of a complete temporal modeling pipeline for explicitly representing frame-to-frame change, enabling appearance-motion interaction, and optimizing temporal direction sensitivity. We propose COMET, a temporally grounded framework that systematically strengthens video MLLMs through explicit temporal representation, appearance-motion fusion, and direction-aware optimization. Architecturally, COM
Referenced by
Claims in this catalog that draw on this source, and whether as support or counterpoint.
- supportsFor 2B-8B video multimodal models, adding a small fraction of time-reversed video rollouts into each GRPO group (e.g. 1 reversed out of 7) raises accuracy on action and temporal-reasoning video QA over standard GRPO, while raising the reversed share further (2 or 3 of 7) gives back the gain.
- supportsFor 2B-8B video multimodal models fine-tuned for temporal reasoning, placing a small minority of reversed-video rollouts in each GRPO group (1 reversed out of 7) beats both all-forward GRPO and larger reversed shares (2 or 3 of 7), because more reversed samples dilute the main forward-video answering objective.