arxiv-2608-18490 SRC-0096 · paper

Bayesian Partner Modelling enables Adaptive Replanning for LLM Coordination

Created: 2026-08-19 · Ingested: 2026-09-15

https://arxiv.org/abs/2608.18490(opens in a new tab)

Multi-agent Large Language Model (LLM) systems often struggle to collaborate with new teammates whose strategies shift mid-task. Because agents execute multi-step or temporally extended skills, they frequently continue executing outdated plans long after public evidence shows that a partner has changed its skill. Existing methods either treat partner tracking as passive context-leaving the agent aware of the shift but slow to act-or replan indiscriminately. We introduce BayesBeliefAgent, which pairs a hierarchical LLM planner with a Bayesian tracking module. Rather than replanning constantly,

In brief

An LLM agent can infer its teammate's current skill correctly and still act on a stale plan; the useful fix is using the partner posterior to decide when to interrupt, not to enrich the planner prompt. BayesBeliefAgent pairs a hierarchical LLM planner with a non-LLM recursive Bayesian estimator over a fixed skill library, interrupting the ego skill only when a newly observed partner action is unlikely under a stable, confident MAP estimate.

Evaluation covers Overcooked/Burrito on Open, Ring and Forced Coordination layouts against 12 behavior-preference partners in 3 groups, with GPT-4o and GPT-5.2, 5 seeds per partner, versus ProAgent, Hypothetical Minds, GAMMA and TALENTS.

Skill-prediction accuracy is essentially tied with ProAgent (0.79 vs 0.78 Open, 0.71 vs 0.71 Ring), yet the belief-action gap falls from 0.41 to 0.20 on Open and 0.38 to 0.28 on Ring, with duplicate-skill rate 0.15 vs 0.30. On Open G1 it reaches 1533 reward with 2.0 replans per episode against 1490 / 43.0, 1510 / 169.0 and 1480 / 119.0 for periodic, event and LLM-judge triggers.

The design isolates the mechanism: a 4-way ablation separates posterior-as-prompt from posterior-as-gate, and all trigger baselines receive identical observations and belief prompts, differing only in the interruption signal.

Boundaries are stated plainly: RL baselines TALENTS and GAMMA still beat all LLM agents in most settings, gains are small on Forced Coordination, skills are hand-specified, and no human partners or within-episode human strategy shifts were tested.

Treat partner belief as a control signal for interruption rather than extra planner context.

Written from the abstract by claude-opus-5 on 2026-09-15, with every figure checked against it. Not a substitute for the paper.

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.