AI Glossary
What is MMLU?
Overview
MMLU, or Massive Multitask Language Understanding, is a broad benchmark that evaluates model knowledge across many academic and professional subjects. It matters because it became a standard reference point for LLM releases, even though newer models increasingly need harder benchmarks to show meaningful gains.
Why it matters
MMLU remains useful as a common baseline, but high scores alone no longer prove frontier-level reasoning.
Where it appears in AI research
- LLM benchmark tables
- Model release announcements
- General knowledge evaluation
- Benchmark saturation analysis