PathCal: State-Aware Reflection-Marker Calibration for Efficient Reasoning
Quick Answer
PathCal introduces a training-free decoding controller that optimizes reasoning paths by distinguishing reflection marker types, enhancing efficiency in Large Reasoning Language Models (LRMs).
Quick Take
PathCal introduces a training-free decoding controller that optimizes reasoning paths by distinguishing reflection marker types, enhancing efficiency in Large Reasoning Language Models (LRMs). Experiments show improved accuracy and reduced generation length across six benchmarks, without needing external verifiers.
Key Points
- PathCal calibrates reasoning paths by intervening at locally uncertain states.
- Different reflection markers influence accuracy and generation length variably.
- The method improves efficiency-performance trade-off in reasoning tasks.
- Experiments conducted on six reasoning benchmarks demonstrate effectiveness.
- No reliance on external verifiers or additional sampling is required.
Paper Resources
Article Content
From source RSS / original summaryarXiv:2605. 23074v1 Announce Type: new Abstract: The emergence of Large Reasoning Language Models (LRMs) has paved the way for tackling complex reasoning tasks through test-time scaling by generating long-form Chain-of-Thought (CoT) trajectories during inference. Meanwhile, these trajectories often contain explicit reflection markers such as ``wait'', ``but'', and ``alternatively'', signaling hesitation, revision, and the consideration of alternative explorations, respectively.
Recent studies on test-time control leverage such markers as lightweight handles for steering reasoning, typically treating them as a single coarse-grained category rather than distinguishing their distinct functional roles. In this paper, we conduct type-wise suppression and fixed-prefix intervention, revealing that reflection markers differ not only in their functional roles but also in when they exert the greatest influence.
Specifically, different marker classes affect accuracy and generation length in distinct ways, and marker choices are most consequential before the model settles into a stable reasoning trajectory. Motivated by these findings, we introduce PathCal, a novel training-free decoding controller that calibrates reasoning paths by distinguishing marker types and intervening only at locally uncertain states.
At each decoding step, PathCal utilizes the distribution over reflection-markers to estimate local competition between maintaining the current reasoning trajectory and initiating a competing branch, and softly rebalances marker logits when competing-branch evidence becomes excessive.
Experiments across six reasoning benchmarks demonstrate that PathCal achieves a better efficiency--performance trade-off, improving or preserving accuracy while reducing generation length, without relying on external verifiers or additional sampling.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.AI
See more →Onnes: A Physics-Grounded LLM Simulator for Cryogenic Fault Diagnosis in Quantum Computing Infrastructure
Onnes is a physics-grounded digital twin simulator for dilution refrigerators, enhancing cryogenic fault diagnosis in quantum computing. It achieves a classification accuracy of 99.0% using few-shot demonstrations, matching a supervised ML classifier, while maintaining a low false alarm rate of 6.4% on real hardware.