arxiv-2512-08743 SRC-0337 · paper

Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligence

Created: 2025-12-09 · Ingested: 2026-09-19

Foundation models (FMs) are increasingly assuming the role of the ''brain'' of AI agents. While recent efforts have begun to equip FMs with native single-agent abilities -- such as GUI interaction or integrated tool use -- we argue that the next frontier is endowing FMs with native multi-agent intelligence. We identify four core capabilities of FMs in multi-agent contexts: understanding, planning, efficient communication, and adaptation. Contrary to assumptions about the spontaneous emergence of such abilities, we provide extensive empirical evidence, across 41 large language models and 7 chal

In brief

Gains on math, code, and knowledge benchmarks across model generations do not carry over to theory-of-mind or coordination tasks, and coordination performance has stayed roughly flat since 2023.

The authors evaluated 41 instruction-tuned open-weight models from the Qwen and LLaMA families, 0.5B to 235B parameters, releases spanning 2023 to 2025, on 7 benchmarks: MATH-500, MMLU-Pro, HumanEval, GPQA as single-agent tasks; ToMBench and EmoBench for multi-agent understanding; CoordinationQA (198 questions from 4 coordination games) for multi-agent planning.

For ~8B Qwen models, single-agent accuracy rose from 0.23 to 0.64 across Qwen-1 to Qwen-3 while multi-agent understanding moved only from 0.44 to 0.55. For ~72B, 0.42 to 0.71 versus 0.57 to 0.67. CoordinationQA accuracy for ~8B models stayed between 0.2 and 0.35 across generations, and ~72B models declined slightly in places (LLaMA-3 to LLaMA-3.1). Models with single-agent accuracy of 0.6–0.8 show wide spread in coordination accuracy.

The effect is measured, but it is a generational cross-section, not a controlled intervention: pretraining data, tuning, and scale all vary together, so nothing isolates why the gap persists. Only 2 open-weight families; no frontier closed models, no reasoning models, and communication and adaptation were argued but never tested.

If you expect multi-agent competence for free from better base models, these curves argue otherwise.

Written from the abstract by claude-opus-5 on 2026-10-17, with every figure checked against it. Not a substitute for the paper.

Referenced by

Claims in this catalog that draw on this source, and whether as support or counterpoint.

supportsAcross 41 models and seven multi-agent benchmarks, gains in single-agent capability translate only weakly into multi-agent competence (understanding other agents, joint planning, efficient communication, adaptation); on the multi-agent planning task accuracy rose only about 30% across a family's full scale range, so coordination ability does not emerge from scaling alone and needs its own data and training.