Only models with substantial code pretraining track entity state through a sequence of operations, and all degrade as the sequence lengthens.

Capability: Tracking state through a long task

Sources

supportsEntity Tracking in Language Models
Only models with substantial code pretraining track entity state through a sequence of operations, and all degrade as the sequence lengthens.

Reviewed by AI and Russ MillerLast checked: 2026-09-03Evidence activity

Either way, bring evidence: a link, or what you saw.

Disagreeing is the most useful thing you can do here. Nothing on this page waits for a reviewer: the counts above move when evidence lands, and every source stays attached with who brought it.

Related claims

For single-agent procedural tasks where the relevant state fits a fixed schema known in advance, replacing the appended conversation transcript with a structured execution state that the model rewrites each step — discarding the reasoning trace once the state patch is validated — holds accuracy flat as the horizon grows while history-appending runtimes degrade, and the gain comes from the structure rather than the shorter prompt.Completing tasks that take many steps or many hours · reviewed by AI
Most models claiming long contexts fail well before their advertised length on synthetic retrieval, tracing and aggregation tasks.Losing information in long inputs
For long cooking videos where a question depends on ingredient changes no longer visible, vision-language models fail to carry observed events forward into later answers, and adding generic retrieved-context RAG makes it worse, while splitting memory into a temporally anchored event log plus an explicitly updated inventory ledger recovers much of the gap.Tracking state through a long task · reviewed by AI
On verifiable instructions such as length and format constraints, strong models still fail a meaningful share, and failures grow when several constraints apply at once.Following an unfamiliar procedure
For a 7B code model fine-tuned on competitive-programming tasks, training it to emit a fixed-schema requirement specification (goals, input/output constraints, examples, edge cases, dependencies) before the code raises Pass@1 more than training it to emit free-form reasoning or a stepwise implementation plan of similar length, with the largest margin on an out-of-distribution benchmark.Generating and editing working code · reviewed by AI