arxiv-2609-14992 SRC-0268 · paper

MTAC-IFBench: Benchmarking Instruction-Following in Multi-Turn Agentic Coding

Created: 2026-09-14 · Ingested: 2026-09-18

https://arxiv.org/abs/2609.14992(opens in a new tab)

Recently, the rapid development of large language models (LLMs) has reshaped software engineering by enabling autonomous code agents that plan, execute, and utilize external tools iteratively to tackle complex tasks. Beyond achieving functional correctness, these agents must faithfully follow process instructions and constraints throughout the development lifecycle. However, existing benchmarks typically focus on final functional correctness or confine instruction-following evaluation to single-turn, general chat or simple code generation scenarios, leaving instruction-following in multi-turn

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.