arxiv-2609-14992 SRC-0268 · paperMTAC-IFBench: Benchmarking Instruction-Following in Multi-Turn Agentic Coding
Created: 2026-09-14 · Ingested: 2026-09-18
https://arxiv.org/abs/2609.14992(opens in a new tab)Recently, the rapid development of large language models (LLMs) has reshaped software engineering by enabling autonomous code agents that plan, execute, and utilize external tools iteratively to tackle complex tasks. Beyond achieving functional correctness, these agents must faithfully follow process instructions and constraints throughout the development lifecycle. However, existing benchmarks typically focus on final functional correctness or confine instruction-following evaluation to single-turn, general chat or simple code generation scenarios, leaving instruction-following in multi-turn
Referenced by
Claims in this catalog that draw on this source, and whether as support or counterpoint.