MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation
Quick Answer
This paper shows that The MODE-RAG system utilizes Variational Free Energy and multi-agent architecture to mitigate hallucinations in Multimodal Retrieval-Augmented Generation, significantly enhancing robustness against logical fabrications.
Quick Take
By employing Monte Carlo Tree Search and dedicated agents for correction and verification, it effectively reduces hallucination rates, as demonstrated through extensive experiments on the ModeVent benchmark.
Key Points
- MODE- employs a to dynamically gate interventions.
- High-risk queries are processed by five stage-specific agents for enhanced accuracy.
- Monte Carlo Tree Search is integrated for rigorous causal derivation.
- Dedicated agents ensure formatting stability and factual verification.
- Extensive experiments show reduced hallucination rates and improved robustness.
Paper Resources
Article Content
From source RSS / original summaryarXiv:2606. 17449v1 Announce Type: new Abstract: While Multimodal (M-RAG) enhances Large , it remains highly susceptible to cross-modal hallucinations, causal fabrications, and sycophancy. Furthermore, existing mitigation pipelines often face an intervention paradox: static rules tend to unnecessarily disrupt accurate generations, whereas leaving the multi-modal reasoning completely unguided allows existing mismatches to cascade into severe logical fabrications.
To quantify and mitigate these hallucinations, we propose a , MODE-RAG, driven by Variational Free Energy (VFE) and internal attention states to dynamically gate interventions. High-risk queries are routed to five stage-specific agents, integrating Monte Carlo Tree Search (MCTS) for rigorous causal derivation and logit perturbations to penalize sycophancy. Dedicated Correction and Overseer agents ensure formatting stability and perform post-hoc factual verification.
To objectively evaluate our approach, we introduce ModeVent, a challenging subset derived from the MultiVent dataset. Extensive experiments indicate that our system effectively reduces hallucination rates and logical fabrication, significantly improving the robustness of M-RAG systems.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CL
See more →TriAgent: Divergence-Aware Committees for Cost-Efficient Financial Sentiment Analysis
TriAgent introduces a cost-efficient multi-agent system for financial sentiment analysis, combining VADER, FinBERT, and Qwen2.5. It achieves an F1 score of ~0.87 with significant savings of $9.3M/year at a 10M-user scale compared to GPT-4o-mini, while also detecting hallucinations with an AUC of 0.90.