Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Benchmark Contamination
Benchmark Contamination
Subtopic
5 questions
Questions tagged with Benchmark Contamination — part of Fine-Tuning.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
When eval prompts appear verbatim inside an SFT file after a synthetic-data run, what's the root cause?
Short Answer
Medium
·
Qual 4.0
MMLU appears on every model leaderboard. Describe what it tests and its biggest blind spot.
Flashcard
Easy
·
Qual 4.0
Non-obvious modes of train/test leakage in instruction-tuning evaluation
Short Answer
Hard
·
Qual 4.0
Which of these are real train/test leakage modes for an instruction-tuning project?
Multi-select
Medium
·
Qual 4.0
What does SWE-bench measure that AgentBench does not, and why are both needed?
Short Answer
Hard
·
Qual 4.0
Cursor