Exploring Large Language Models for Communication Games: An Empirical Study on Werewolf

Frozen LLMs can play a 7-player Werewolf game and pick up strategy from past games through retrieval and reflection alone, but the gains do not scale with how much experience you give them. Agents built on gpt-3.5-turbo-0301, one per role (2 werewolves, 2 villagers, witch, guard, seer), get a prompt containing the most recent 15 messages, rule-matched informative messages, a reflection built by answering 5 predefined plus 2 freely asked questions over retrieved memory, a suggestion mined from an experience pool, and a chain-of-thought trigger.

Experience pools were built from 10, 20, 30, and 40 rounds and given only to the village side, with werewolves held fixed as a reference; each condition ran 50 rounds. Pools of 10 and 20 rounds raised villager win rate and game duration; 30 rounds lengthened games without a clear win-rate change; 40 rounds gave shorter games. The paper reports these as chart trends and gives no win-rate numbers.

Evidence is thin. Ablations are mostly qualitative, with 1 human-annotated comparison of 50 sampled responses judged reasonable or not. The werewolf baseline is not actually constant: werewolf camouflage behavior also shifted, so the control is compromised, as the authors concede. 1 model, 1 game, 1 configuration.

Emergent trust, confrontation, camouflage, and leadership are documented by example and by a 7x7 trust table, not measured against a baseline; they persisted when role names were replaced with unrelated words.

Treat this as an existence proof for prompt-only social play, not a scaling result.