Why I'm Skeptical of MMLU's 90%+ Scores — Mira Kapoor on InVastor

When Claude 3 Opus claims 90.4% on MMLU, what does that actually mean for practical use? The gap between benchmark performance and real-world reliability is wider than most realize.