arxiv-2608-29345 SRC-0450 · paper

BIRD-History: A Benchmark for History-Driven Text-to-SQL with Fine-Grained Knowledge Annotations

Created: 2026-08-29 · Ingested: 2026-10-17

https://arxiv.org/abs/2608.29345(opens in a new tab)

While recent Large Language Model (LLM)-based text-to-SQL systems achieve impressive performance on standard benchmarks, they struggle when user queries implicitly rely on domain-specific knowledge, such as business logic, data conventions, and analytical practices, that is neither captured by the schema nor explicitly stated in the natural language question. Historical SQL query logs offer a valuable source of such knowledge, yet existing benchmarks do not adequately support evaluation of history-driven approaches. To address this gap, we introduce BIRD-History, a benchmark consisting of 1,39

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.