DECOR: Auditing LLM Deception via Information Manipulation Theory
Quick Take
DECOR is a framework for auditing LLM deception using Information Manipulation Theory.
Key Points
- DECOR scores information units for manipulation in LLM responses.
- Achieves state-of-the-art performance in deception detection benchmarks.
- Generalizes across 15 advanced language models.
📖 Reader Mode
~2 min readAbstract:Large language models can deceive by subtly manipulating truthful information -- omitting key facts, shifting focus, or obscuring meaning -- making such behavior difficult to detect. Existing black-box methods rely on coarse-grained judgments, offering limited interpretability and failing to pinpoint which facts were distorted and how. We introduce DECOR, a multi-agent framework grounded in Information Manipulation Theory for fine-grained auditing of strategic deception in LLM responses. DECOR decomposes input contexts into atomic informational units and scores each unit against the response across four dimensions of manipulation, producing interpretable manipulation profiles that are aggregated into a global deception index. We comprehensively evaluate DECOR on both single-turn and multi-turn deception detection benchmarks spanning real-world domains, and show that DECOR achieves state-of-the-art performance on both, outperforming competitive baselines. The framework generalizes across 15 frontier models, and ablation studies confirm the contribution of each key design component. Our findings demonstrate that fine-grained, theory-grounded auditing of information manipulation offers an effective and interpretable path for LLM deception detection.
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2605.19270 [cs.CL] |
| (or arXiv:2605.19270v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2605.19270 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Samuel Yeh [view email]
[v1]
Tue, 19 May 2026 02:33:21 UTC (491 KB)
— Originally published at arxiv.org
More from arXiv cs.CL
See more →Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
The reliability of LLM judges for evaluating deep research agents is critically assessed using the REFLECT benchmark.