Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Data Leakage
Data Leakage
Subtopic
8 questions
Questions tagged with Data Leakage — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
A small medical fine-tune leaks verbatim credit card snippets under red teaming: identify the failure mode and the standard mitigation
Short Answer
Hard
Premium
Spot the bug: packed…
Spot the Error
Hard
Why does using the same model family as synthetic data teacher AND eval judge inflate FT scores?
Multiple Choice
Medium
Premium
When eval prompts appear…
Short Answer
Medium
A model aces a benchmark with suspiciously high scores. The first hypothesis is contamination. Explain what that means to a non-technical PM.
Flashcard
Easy
Spot the flaw: 'We fine-tuned on 10K examples and eval on a random 500 from the same dataset. Accuracy is 94%, so the model is ready for production.'
Spot the Error
Medium
Non-obvious modes of train/test leakage in instruction tuning evaluation
Short Answer
Hard
Which of these are real train/test leakage modes for an instruction tuning project?
Multi-select
Medium
Meta
Replicate
Coinbase
LlamaIndex
Comet Ml
Polyai
Cognizant
Cursor
Goldman Sachs
Sarvam
Cerebras
Character Ai
Amd
Snorkel Ai
Comet Ml
Tech Mahindra