many-failures-come-from-not-following-domain-policy
mechanismsingle paper

Many failures come from not following domain policy documents that were provided in the prompt.

Capability: Following an unfamiliar procedure

Sources

Status: activeLast checked: 2026-09-03Evidence activityHow much the field cites the sources under this claimvery heavily cited in the last 12 months889 in 12mo · 1075 total — τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
Contest this claim

Disagreeing is the most useful thing you can do here. Both sides of every contested claim in this catalog were assembled by the same person, which is its weakest point.