Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Eval Set Contamination
Eval Set Contamination
Subtopic
3 questions
Questions tagged with Eval Set Contamination — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
A model aces a benchmark with suspiciously high scores. The first hypothesis is contamination. Explain what that means to a non-technical PM.
Flashcard
Easy
·
Qual 4.0
Explain benchmark contamination and its effect on reported LLM capability scores
Short Answer
Medium
·
Qual 4.0
Which methods are practical approaches for detecting train-eval data leakage in LLM benchmarks?
Multi-select
Hard
·
Qual 4.0