arxiv-2608-18884 SRC-0423 · paperTraining-Free Inference-Time Self-Reflection and Cost-Bounded Early Stopping for Large Language Models
Wei Yu, Suxing Liu, Minjie Yu, Jiahao Wang, Zhijian Zheng, Haocheng Deng
Created: 2026-08-19 · Ingested: 2026-10-17
https://arxiv.org/abs/2608.18884(opens in a new tab)Reinforcement-learning training of reasoning LLMs (e.g., GRPO) is expensive and requires a controllable environment, committing every contribution to a full training pipeline. We present EvoResearcher, a training-free, inference-time protocol that adds cost-bounded self-reflection to a single frozen LLM backbone. The protocol iterates generate -> self-critique -> revise until a maximum depth D is reached or the critique returns the CONFIRMED sentinel, an implicit early stop that lets the backbone self-verify its answer under a strict compute budget. Four self-reflective meta-reward components
Referenced by
Claims in this catalog that draw on this source, and whether as support or counterpoint.
- supportsFor a frozen LLM run in a generate-critique-revise loop with no external feedback, the accuracy gain is concentrated where single-shot reasoning is already unreliable: on clean multi-step reasoning (BBH, ~74% single-shot) depth makes no difference beyond the confidence interval, while on harder math (MATH, 26.2% single-shot) the same loop gains +14.2 points, with GSM8K in between (+4.2).
- supportsIn a training-free generate-critique-revise loop on a frozen backbone, a self-reported numeric confidence tag is useless as a stopping signal because the model declares high confidence on essentially every first generation (every threshold from 0.6 to 0.9 halted the loop at step 1 on 100 BBH questions), whereas a textual CONFIRMED sentinel from the critique stops 82-88% of items at unchanged accuracy.