Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Home
/
Roles
/
AI Researcher
AI Researcher
288 questions
Works on the science, papers, theory, training dynamics, novel architectures, scaling laws.
Topics
Format
Difficulty
Companies
Track
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Misconception: 'higher LoRA rank always wins on benchmarks'
Multiple Choice
Medium
·
Qual 4.0
Misconception: 'LoRA is just a quantization technique'
Multiple Choice
Easy
·
Qual 4.0
Membership inference on fine-tuned models. Why are small FT datasets vulnerable?
Short Answer
Hard
·
Qual 4.0
Why are small FT datasets especially vulnerable to membership inference?
Multiple Choice
Medium
·
Qual 4.0
LoRA+: why does B want a higher learning rate than A?
Multiple Choice
Hard
·
Qual 4.0
Why is LoRA's B initialised to zero and A to Gaussian. What breaks if both are Gaussian?
Short Answer
Hard
·
Qual 4.0
LoRA init: why B = 0 and A ~ Gaussian (not both Gaussian)?
Multiple Choice
Medium
·
Qual 4.0
Explain why a rank-r B·A update captures most of full fine-tuning's signal
Short Answer
Hard
·
Qual 4.0
Can you stack two LoRA adapters? What's the failure mode?
Short Answer
Hard
·
Qual 4.0
Stacking two unrelated LoRA adapters: most likely outcome
Multiple Choice
Hard
·
Qual 4.0
What does LoRA's α/r ratio control, and why is α = 2r a common default?
Short Answer
Hard
·
Qual 4.0
If you change LoRA's rank from 16 to 64 with α fixed, what actually happens?
Multiple Choice
Medium
·
Qual 4.0
When would you pick KTO over DPO?
Short Answer
Medium
·
Qual 4.0
IA3 vs LoRA: what does IA3 parameterise, and what's the param-count win?
Short Answer
Medium
·
Qual 4.0
Why can fine-tuning on domain facts INCREASE hallucination?
Short Answer
Hard
·
Qual 4.0
Why does fine-tuning on company docs often raise hallucination instead of lowering it?
Multiple Choice
Hard
·
Qual 4.0
DPO: what's the closed-form trick that lets it skip the reward model?
Short Answer
Hard
·
Qual 4.0
DPO vs RLHF: pick the most accurate operational difference
Multiple Choice
Medium
·
Qual 4.0
DPO failure modes: large β, small β, noisy preferences
Short Answer
Hard
·
Qual 4.0
What does DoRA decompose, and why does it beat LoRA at the same rank?
Short Answer
Hard
·
Qual 4.0
DoRA: which component does LoRA actually adapt?
Multiple Choice
Hard
·
Qual 4.0
FT-based distillation vs logit distillation: and what works with closed APIs
Short Answer
Medium
·
Qual 4.0
Distillation with a closed-API teacher: which method is feasible?
Multiple Choice
Medium
·
Qual 4.0
Extending a 4k-context model to 32k via FT: how RoPE scaling fits in
Short Answer
Hard
·
Qual 4.0
Why does pure long-context FT (without RoPE scaling) fail to extrapolate?
Multiple Choice
Hard
·
Qual 4.0
Showing 151–175 of 288
← Prev
Next →