Hallucination as Commitment Failure: Larger LLMs Misfire Despite Knowing the Answer
Quick Take
Larger LLMs exhibit hallucinations despite knowing answers due to probability distribution issues.
Key Points
- Hallucinations occur even with correct concepts available.
- Probability mass distribution distinguishes correct answers from hallucinations.
- Instruction tuning enhances answer commitment with model scale.
Reader Mode unavailable (could not extract clean content).
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CL
See more →Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
The reliability of LLM judges for evaluating deep research agents is critically assessed using the REFLECT benchmark.