Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Lr Schedule
Lr Schedule
Subtopic
6 questions
Questions tagged with Lr Schedule — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Find the schedule assumption that breaks when accumulation steps change
Spot the Error
Easy
Pick the most likely cause when training loss drops for 1k steps, plateaus for 2k, then drops again at step 3k
Multiple Choice
Medium
Why ramp the learning rate during warmup instead of starting at the peak value?
Flashcard
Easy
Loss spikes the moment warmup ends: which hyperparameter is the prime suspect?
Short Answer
Medium
Pick the three first things to check when LoRA training loss sits flat from step 0
Multi-select
Medium
Fill in typical peak LRs for full FT, LoRA, and DPO
Fill in Blank
Medium
Autodesk
Baidu
Cognizant
Mercor
Stability Ai
Typeface
Cresta
Ltimindtree
Crewai
OpenAI
Lyzr
Palantir