From Context-Aware to Conflict-Aware: Generalizing Contrastive Decoding for Knowledge Conflict in LLMs
Quick Answer
This paper introduces a conflict-aware paradigm for contrastive decoding in large language models, addressing reliability issues by dynamically balancing context and parametric priors.
Quick Take
This paper introduces a conflict-aware paradigm for contrastive decoding in large language models, addressing reliability issues by dynamically balancing context and parametric priors. The proposed Adaptive Regime Routing (ARR) improves error resistance from below 6 to 16–33 without sacrificing correction or agreement. The evaluation protocol, TriState-Bench, measures three conflict states: correction, resistance, and agreement.
Key Points
- Conflict-aware paradigm dynamically balances context and parametric priors.
- Adaptive Regime Routing (ARR) improves error resistance significantly.
- TriState-Bench evaluates three conflict states in language models.
- Existing methods primarily rely on context, leading to reliability issues.
- Code for the proposed methods is available on GitHub.
Paper Resources
Article Content
From source RSS / original summaryarXiv:2606. 10298v1 Announce Type: new Abstract: When large language models generate from retrieved or augmented contexts, conflicts between external context and parametric priors remain a central reliability bottleneck. Existing contrastive decoding methods follow a \emph{context-aware} paradigm that unilaterally amplifies context over parametric priors, overwriting correct priors when the context is erroneous.
We generalize this to the \textbf{conflict-aware} paradigm that dynamically allocates authority between prior and context based on conflict signals, rather than presupposing context trustworthiness. We show that the affine combination of prior and context logits yields a \textbf{power family} with an inherent \textbf{regime asymmetry}: extrapolation amplifies errors unboundedly when the prior is correct, interpolation under-corrects when the context is correct, and no static regime covers both.
Existing contrastive decoding methods are instances of this family, mostly extrapolative. To evaluate both conflict directions, we propose TriState-Bench, a model-aware evaluation protocol that calibrates per-model prior knowledge to measure three conflict states: correction, resistance, and agreement. To resolve the asymmetry, we propose Adaptive Regime Routing (ARR), which routes between regimes at each step, lifting resistance EM from below 6 to 16--33 without sacrificing correction or agreement.
Our code is available at https://github. com/keith-Jiang/conflict-aware-decoding.
Reader Mode unavailable (could not extract clean content).
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.AI
See more →Arbor: Tree Search as a Cognition Layer for Autonomous Agents
Arbor introduces a multi-agent framework utilizing structured tree search for optimizing LLM inference, achieving up to 193% throughput-latency improvement compared to vendor-optimized systems. It employs an Orchestrator and Critic agent for stability and coordination, demonstrating hardware-agnostic performance with minimal variance.