Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Mmlu
Mmlu
Subtopic
5 questions
Questions tagged with Mmlu — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Walk through the triage order when a customer-support LoRA tanks MMLU by 4 points post-deploy
Order Steps
Medium
·
Qual 4.0
Every model release cites benchmark numbers. Define what a benchmark actually is and name two things it cannot tell you.
Flashcard
Easy
·
Qual 4.0
MMLU appears on every model leaderboard. Describe what it tests and its biggest blind spot.
Flashcard
Easy
·
Qual 4.0
Why does Chatbot Arena (LMSYS) give a different picture of model quality than static benchmarks like MMLU?
Multiple Choice
Easy
·
Qual 4.0
How do you detect catastrophic forgetting after a domain fine-tune?
Short Answer
Medium
·
Qual 4.0