arxiv-2609-09672 SRC-0230 · paper

SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia

Jingyi Liao, Wenyu Zhang, Zhuohan Liu, Yingxu He, Geyu Lin, Xunlong Zou

Created: 2026-09-09 · Ingested: 2026-09-19

The rapid advancement of audio and multimodal large language models has unlocked transformative speech understanding capabilities, yet evaluation frameworks remain predominantly English-centric, leaving Southeast Asian (SEA) languages critically underrepresented. We introduce SEA-SpeechBench, to the best of our knowledge, the first large-scale multitask benchmark that evaluates speech understanding in 11 SEA languages through 97,194 samples across 99 evaluation sets and 597 hours of curated audio data. Our benchmark comprises 9 diverse tasks across 3 categories: speech processing (automatic sp

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

supportsOn audio temporal-localization tasks in 11 Southeast Asian languages, current audio LLMs return time spans whose coverage of the true span consistently exceeds their purity, and F1 falls steadily as the recording grows from under 30 seconds to 3 minutes, with several models unable to run at all on the longer bins.