multi-model-coordination CAP-0031 · active

Getting more from several models than from one

Whether a system of several models or agents — debating, voting, dividing work, or sharing state — does better than its best single member; the failure is a quorum of copies that agree on the same mistake.

Also called: multi-agent systems, ensembles, model quorum, mixture of agents, LLM debate

Tags: agentic, autonomous-agent

Filed 2026-09-17 when the Cache-to-Cache paper arrived and the map had no leaf for it, a week after the DAIR collection's multi-agent paper went to the proposal stage for the same reason. The adages "two heads are better than one" and Ashby's law of experience hold this catalog's prior: the gain depends on the heads being different, and instances of one model sharing a context are one head. Claims here are about the coordination mechanism itself — debate, majority vote, role division, verifier separation, or sharing internal state instead of text — measured against the strongest single model at matched cost. Independent verification of a producer's output sits under fixing its own mistakes.

What counts as this capability

Scope boundary used when deciding whether a paper is really about this capability, rather than merely mentioning it.

In scope when the paper measures a system of several models or agents against a single-model baseline and attributes the difference to how they are combined or communicate. NOT in scope for a single model sampled several times with no combination rule, for a second model used only as a verifier (self repair), or for multi-agent RL environments where the subject is the environment.

Claims

Techniques

  • Arbitrate conflicting evidence streams by relevance-gated fuprocess
    Generate perception, retrieval and web-verification evidence with the same backbone, score each stream for relevance/accuracy/discriminativeness, softmax-weight them into a fused answer, and refine under six cultural rubric criteria.
  • Audit agent influence with belief probes and exposure logsprocess
    Instead of reading agent messages, score each agent's stance after every round with a fixed token-probability probe and log who saw which content from whom, so influence can be attributed to direct or peer-relayed exposure.
  • Compare agent pruning against random pruning at equal budgetprocess
    For every structural change a multi-agent optimizer emits, build a random topology with the same node/edge budget and evaluate it under identical model, agents, roles and runtime, so the credit goes to the optimizer rather than to having de
  • Compose role steering vectors per query instead of debatingtraining
    A learnable codebook of role steering vectors, warm-started from contrastive activation directions and fused by a query-aware top-K router, is added to the last prompt token's residual stream at the middle layer of a frozen LLM, trained by
  • Coordinate agents through a persistent shared world, not mesprocess
    Let role-free agents build durable, executable artifacts in a shared simulated environment so later agents inherit and modify them, instead of coordinating through conversation or assigned roles.
  • Coordinate hypothesis agents with a generational genetic algprocess
    Specialized LLM agents generate, pairwise-score and semantically recombine or mutate structured hypotheses, with a genetic algorithm doing tournament parent selection and joint parent-offspring truncation to a fixed population.
  • Debate-Mixture-of-Agents: rebut, revise, then aggregateprocess
    Each debater runs a presenter that drafts a diagnosis, a rebutter that attacks it for missing evidence and unsafe omissions, and a presenter revision; a separate aggregator then merges all revised hypotheses without forcing consensus.
  • Drop CAE scaffolding, supply solver tutorials insteadprocess
    Run CAE simulation tasks with an off-the-shelf coding-agent harness (file, shell, multi-turn, execution feedback) and no simulation-specific roles, retrieval pipeline or reflection prompt, while requiring the agent to read the relevant solv
  • Exchange typed logical edges, not dialogue, between agentsprocess
    Each modality agent builds a local evidence graph and agents update one another only by establishing typed edges (cascade, syndrome, exclusion, context) before an expert agent arbitrates the merged candidate graphs against a referral knowle
  • Gate worker outputs on semantic entropy plus densityprocess
    The orchestrator resamples each worker response, computes semantic entropy and embedding-space semantic density, and accepts only if both clear thresholds, otherwise reprompts, reassigns, or delegates in parallel.
  • Generate the agent topology after retrieval, conditioned on process
    Retrieve evidence first, then autoregressively generate the multi-agent DAG (roles and edges) conditioned on the retrieved evidence and its provenance, with a generator trained on execution-scored, cost-pruned candidate topologies.
  • Keep inter-agent handoffs in the user's languageprocess
    Have agents pass extracted facts and answers to each other in the user's language instead of pivoting through English translation.
  • Learn agent action selection instead of scripting a pipelineprocess
    Each LLM agent reads a 20-dimensional summary of its private notes, shared knowledge, draft and feedback and picks Retrieve, Disseminate, Compose or Critique under a shared IPPO policy, instead of being assigned a fixed pipeline role.
  • Match the agent hierarchy to task interdependenceprocess
    Construct a per-mission manager tree in which horizontal managers hand out concurrent assignments to their children and vertical managers decompose the mission into ordered phases and advance only when completion conditions are met, with re
  • Pass graph structure as a permutation-invariant signature, nprompting
    Summarize sampled graph neighborhoods for an LLM agent as a fixed-length vector of named graph statistics, keeping raw text only for the top-k semantically relevant nodes, so the observation is order-independent and does not grow with neigh
  • Rank communication edges by masking effect, then prune to buprocess
    Mask each communication edge in a generated multi-agent graph, score it by the drop in task score plus the rise in semantic entropy of the final response, keep the top-ranked edges under a pruning budget, and distill those subgraphs into a
  • Reflect only the agent that made the first wrong stepprocess
    A process-reward model scores each step of a failed multi-agent trajectory, the first low-scoring step and its agent are identified, a corrected version of that step is generated and verified, and only that agent writes a reflection into it
  • Replay extracted skills, tricks and model cards to the orcheprompting
    Run the swarm, summarize trajectories into SKILL.md workflow patterns, a trick library, and per-backbone model cards, and reinject all three into the orchestrator's prompt at inference.
  • Replay the recorded prefix, then intervene at the symptomatiprocess
    Log every model and tool boundary interaction as an event-dependency graph, replay it deterministically up to a node flagged by symptom rules plus a semantic judge, inject a repair instruction conditioned on the symptom category, and resume
  • Retrieve debate memory by consensus level, then reweight peeprompting
    Each debating agent retrieves past-debate cases with an MMR trade-off whose relevance/diversity coefficient is set by the current consensus ratio (high consensus pulls in contrastive cases), and labels each peer's response high- or low-conf
  • Reward each model by a peer model's majority vote, not its otraining
    Train several parameter-disjoint models simultaneously with RL, where each model's rollouts are scored against the majority-vote answer of a different model in the cohort, passed along a directed ring.
  • Route each agent step by predicted task-progress gainprocess
    Scores intermediate workflow state into a progress value, predicts each candidate model's progress gain from structured and semantic features, and picks the model maximizing gain minus time/cost-budget penalties at every dispatch step.
  • Route images to expert backbones with a prompted MLLMprocess
    An MLLM is prompted with the image plus blur/brightness/contrast/noise statistics and outputs one of five domain labels, dispatching the image to the matching fine-tuned vision expert, with an UNSURE option falling back to the best balanced
  • Route multi-agent steps over a gated execution memoryprocess
    A jointly trained router picks each step's role and backbone from a memory kept compact by learned write and retrieval gates, and halts when the memory holds enough evidence.
  • Score coordination constructs separately from task successprocess
    Alongside the binary goal check, compute per-trajectory construct scores from simulator-logged events — makespan versus an oracle reference, precedence-violation rate with a legality gate, shared-resource collision rate, and buffer overflow
  • Shared semantic blueprint, parallel restructuring branches, process
    One agent reconstructs the source program's states, operators and dependencies into a structured representation and a target-side blueprint; several agents then generate alternative tensor realizations under that blueprint, failures are rep
  • Size an ensemble by its marginal-gain (benefit yield) curveprocess
    Treat ensemble performance as a function of member count and stop adding models at the size where marginal gain per added model crosses zero.
  • Split forensic analysis into per-cue agents, reconcile with process
    Four MLLM agents each inspect the same sampled video frames for one forgery cue type and report observations without a verdict; a judge agent weighs the four reports (optionally plus the frames) and issues the real/fake decision and explana
  • Switch from dense to sparse agent topology as disagreement fprocess
    The harness selects all-to-all inter-agent communication while aggregate disagreement exceeds a threshold and a ring topology once it falls below, with a token budget decremented each round and a guard that halts on exhaustion.
  • Train only the central coordinating agent, freeze sub-agentstraining
    Treats sub-agents as part of the environment and applies RL gradients only to the central agent's policy, with trajectories reconstructed from captured per-session interface call records.
  • Train the orchestrator on descriptor-conditioned routing platraining
    Fine-tune the planning model to emit a rationale plus an ordered sub-agent plan from tool descriptors, then refine with GRPO rewarding parseable output, coverage F1 against the target plan, and satisfied precedence edges.
  • Weight peers by cognitive SNR, not by divergenceprocess
    Each incoming agent message is weighted by the sender's asserted belief precision divided by the KL divergence between its reported belief and what the receiver's second-order model predicts a peer with that telemetry access should have rep

Sources

Every paper, post or observation behind this capability. Ones cited by a claim show the claim and its stance; ones filed directly are about the capability but have no claim drafted from them yet. Open one to add support or contest it.

Suggest a change

Capabilities are a way of carving up the subject, and carvings are arguable. Say so if this one is wrong — especially a proposed one, which a pipeline added because several papers used the same framing, not because anyone decided it was right.