Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Lr Schedule
Lr Schedule
Subtopic
5 questions
Questions tagged with Lr Schedule — part of Fine-Tuning.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Pick the most likely cause when training loss drops for 1k steps, plateaus for 2k, then drops again at step 3k
Multiple Choice
Medium
·
Qual 4.0
Why ramp the learning rate during warmup instead of starting at the peak value?
Flashcard
Easy
·
Qual 4.0
Loss spikes the moment warmup ends: which hyperparameter is the prime suspect?
Short Answer
Medium
·
Qual 4.0
Pick the three first things to check when LoRA training loss sits flat from step 0
Multi-select
Medium
·
Qual 4.0
Fill in typical peak LRs for full FT, LoRA, and DPO
Fill in Blank
Medium
·
Qual 4.0