Same Question, Different Answers: Evaluating LLM Reliability Beyond Accuracy
Quick Answer
This study evaluates the reliability of large language models (LLMs) by examining their responses to paraphrased questions across 13 models and four benchmarks.
Quick Take
Results indicate that while overall accuracy remains stable, instance-level answers fluctuate significantly, with mismatch rates exceeding 23%. A self-paraphrasing strategy shows promise in improving consistency and performance during inference.
Key Points
- Model outputs vary significantly based on prompt wording, with over 23% mismatch rates.
- Instance-level behavior is less stable despite modest overall accuracy changes.
- Correct answers can often be retrieved from at least one paraphrase of a question.
- A self-paraphrasing strategy can enhance performance and recover latent knowledge.
- Standard accuracy metrics may obscure substantial instability in responses.
DeepSignal Analysis
What happened
A study evaluated the reliability of 13 large language models (LLMs) across four benchmarks by analyzing their responses to paraphrased questions. While overall accuracy remained stable, instance-level answers varied significantly, with mismatch rates exceeding 23%. A self-paraphrasing strategy was found to improve consistency and performance during inference.
Key evidence
- The study examined 13 LLMs across four benchmarks to assess their responses to paraphrased questions.
- Mismatch rates for instance-level answers exceeded 23%, indicating significant variability in model responses.
- A self-paraphrasing strategy was shown to enhance consistency and performance during inference.
Why it matters
Understanding the reliability of LLMs is crucial for their deployment in real-world applications. The findings highlight that high accuracy on standard benchmarks does not guarantee consistent performance across different phrasings. This inconsistency could lead to unreliable outputs in critical applications, necessitating improved evaluation methods that focus on response stability rather than just accuracy.
What to watch
Paper Resources
Source Excerpt
(LLMs) often achieve strong accuracy on benchmarks, yet it remains unclear how reliably they apply this knowledge when the same question is phrased in different but equivalent ways. In this work, we study how model answers change under meaning-preserving paraphrases across factual question answering and mathematical reasoning tasks. Across four benchmarks and 13 models, we find that model outputs frequently depend on the exact wording of the prompt. While overall accuracy t
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.AI
See more →AINTMA: Agentic AI Architecture for Autonomous Test Management with Generative Intelligence, Secure Cloud Communication and Adaptive Quality Analytics
AINTMA, an autonomous test management architecture utilizing six specialized AI agents, achieves 88.4% test prioritization accuracy and reduces defect escape rates from 8.3% to 2.1%. The system demonstrates a 340% ROI within nine months, showcasing the potential of agentic AI in enhancing software quality management in cloud environments.