arxiv-2608-22090 SRC-0431 · paperSemantic Reasoning Denoising: Correcting Language Model Reasoning with Semantic Operators
Yujiao Yang
Created: 2026-08-22 · Ingested: 2026-10-17
https://arxiv.org/abs/2608.22090(opens in a new tab)Large language models can produce fluent reasoning traces whose local semantic errors propagate to an incorrect conclusion, while unconstrained self-correction may preserve, amplify, or introduce errors. Existing diffusion language models provide iterative refinement, but usually define noise as token masking or replacement rather than as errors in the reasoning process. We present Semantic Reasoning Denoising (SRD), an operatorized Markov denoising method for natural-language reasoning trajectories. SRD represents semantic noise with executable error operators that describe the error type, it
Referenced by
Claims in this catalog that draw on this source, and whether as support or counterpoint.
- supportsFor 8B instruction-tuned backbones run in an iterative typed-error-operator correction loop, accuracy gains concentrate in the first few iterations and then plateau rather than decline as the denoising budget grows, so a small step budget captures nearly all the benefit.
- supportsFor 8B instruction-tuned backbones, training a LoRA corrector to diagnose a typed, executable error operator (error type, step location, corrupted and repaired proposition) and apply its inverse as a localized edit raises accuracy over free-form self-revision baselines (Self-Refine, RISE, SCoRe) on math, code and commonsense tasks, and dropping either the operator-prediction loss or the adjacent-state reconstruction loss loses most of the gain.