Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Distillation
Distillation
Subtopic
6 questions
Questions tagged with Distillation — part of Fine-Tuning.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Why does using the same model family as synthetic-data teacher AND eval judge inflate FT scores?
Multiple Choice
Medium
·
Qual 4.0
A distilled model hits 92% on a public benchmark but 31% on an internal hold-out: diagnose.
Short Answer
Medium
·
Qual 4.0
DeepSeek-style reasoning distillation: what travels from teacher to student, and what gets cut from the loss?
Short Answer
Medium
·
Qual 4.0
When IS fine-tuning the right call?
Short Answer
Medium
·
Qual 4.0
FT-based distillation vs logit distillation: and what works with closed APIs
Short Answer
Medium
·
Qual 4.0
Distillation with a closed-API teacher: which method is feasible?
Multiple Choice
Medium
·
Qual 4.0