arxiv-2609-14758 SRC-0265 · paperFabrication After Tool Failure: Tool-Augmented Agents Assert Values Their Tools Did Not Return
Created: 2026-09-13 · Ingested: 2026-09-18
https://arxiv.org/abs/2609.14758(opens in a new tab)Tool-augmented language models are evaluated on whether they reach the right answer, not on whether they report honestly when a tool fails to supply one. We isolate this post-failure decision with a benchmark of 1,024 items spanning 16 internal-system domains and eight tool-failure types, in which a tool call is enforced and the returned payload is guaranteed to be unusable. Under a deployment-style system prompt, 14.10% of responses are dishonest: the model either asserts a value the payload cannot support or declines while citing a fabricated policy or capability limit. The rate is governed
Referenced by
Claims in this catalog that draw on this source, and whether as support or counterpoint.