Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Learning Rate
Learning Rate
Subtopic
7 questions
Questions tagged with Learning Rate — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
Why do large runs ramp learning rate before entering cosine decay?
Multiple Choice
Easy
What is the most likely cause when training loss drops for 1k steps, plateaus for 2k, then drops again at step 3k?
Multiple Choice
Medium
Which hyperparameter is most likely when loss spikes the moment warmup ends?
Short Answer
Medium
Match training regime to sensible peak LR range
Match Pairs
Hard
What are typical peak LRs for full FT, LoRA, and DPO?
Fill in Blank
Medium
Why does B want a higher learning rate than A in LoRA+?
Multiple Choice
Hard
Which of these reduce catastrophic forgetting?
Multi-select
Medium
NVIDIA
OpenAI
Mercor
OpenAI
Airbnb
Robust Intelligence
Cresta
OpenAI
Goldman Sachs
Lakera
Lyzr
Palantir
Dify
Flipkart