Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning

Read full text
Authors: Renliang Sun, Wei Cheng, Dawei Li, Haifeng Chen, Wei Wang
Cited by: 0

Abstract

Chain-of-Thought (CoT) reasoning has driven recent gains of large language models (LLMs) on reasoning-intensive tasks by externalizing intermediate steps.However, excessive or redundant reasoning -so-called overthinking -can increase inference costs and lead LLMs toward incorrect conclusions.In this paper, we present REFRAIN (REFlective-Redundancy for Adaptive INference), a training-free framework that adaptively determines when to stop reasoning to mitigate overthinking.REFRAIN integrates a two-stage stop discriminator to identify reflective yet redundant reasoning and a sliding-window Upper Confidence Bound (SW-UCB) multi-armed bandit controller to dynamically adjust stopping thresholds according to problem difficulty without supervision or fine-tuning.Across four representative benchmarks and two model families, REFRAIN reduces token usage by 20-55% while maintaining or improving accuracy compared to standard CoT prompting.Extensive ablation and robustness analyses demonstrate its stability across models, scorers, and prompt variations.In summary, our findings highlight when-tostop as a new and practical axis of test-time scaling -enabling models to reason not just more, but just enough.

Fields of Study & Subjects

Multimodal Machine Learning Applications Topic Modeling Explainable Artificial Intelligence (XAI)

Publication details

Pages
27250–27268
Publication date
1 January 2026
Language
EN