Models that predict next steps well can still hold an incoherent implicit world model, which fails when the task deviates from familiar traces.

Evidence for: Good regulator theorem (holds)

Capability: Tracking state through a long task

Sources

supportsEvaluating the World Model Implicit in a Generative Model
Models that predict next steps well can still hold an incoherent implicit world model, which fails when the task deviates from familiar traces.

Reviewed by AI and Russ MillerLast checked: 2026-09-03Evidence activity

Either way, bring evidence: a link, or what you saw.

Disagreeing is the most useful thing you can do here. Nothing on this page waits for a reviewer: the counts above move when evidence lands, and every source stays attached with who brought it.

Related claims

In interactive video world models, world state communicated only through prompt switching is not reliably preserved across a rollout — characters that should stay alive vanish and killed ones keep moving — whereas keeping the canonical state in an external deterministic engine and compiling it into pixel-aligned spatial controls for the video model keeps the rendered frames consistent with that state.Tracking state through a long task · reviewed by AI
Having a model score its confidence step by step detects failures in multi-step reasoning better than one holistic confidence score for the whole answer, with up to 15% higher AUROC on two multi-step benchmarks, so where a chain fails is more visible per step than in the final answer.Carrying a chain of inference through to its conclusion · reviewed by AI
For long-horizon embodied task planning where a symbolic model defines action preconditions and effects, correcting a violated plan by edits the action model itself implies (inserting the missing navigate or open) raises plan success more per LLM call than returning the violation to the LLM for replanning, and the gain persists for frontier models as well as compact ones.Planning a sequence of actions before acting · reviewed by AI
For VLM agents doing multi-phase navigation and pick-and-place in procedurally generated indoor scenes with moving human obstacles, subtask progress runs well ahead of full success — agents reach the first goal and then stall or loop after the phase transition — so success rate alone hides where the failure is.Turning plans into physical action · reviewed by AI
For single-agent procedural tasks where the relevant state fits a fixed schema known in advance, replacing the appended conversation transcript with a structured execution state that the model rewrites each step — discarding the reasoning trace once the state patch is validated — holds accuracy flat as the horizon grows while history-appending runtimes degrade, and the gain comes from the structure rather than the shorter prompt.Completing tasks that take many steps or many hours · reviewed by AI