Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Optimizer State
Optimizer State
Subtopic
4 questions
Questions tagged with Optimizer State — part of Fine-Tuning.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Order the pieces of state that must be restored to resume a training run bit-exactly
Order Steps
Medium
·
Qual 4.0
Which of these is actually saved when a fine-tuning checkpoint is written?
Multiple Choice
Easy
·
Qual 4.0
Adam optimizer state per parameter: fill in the moment buffers and bytes
Fill in Blank
Easy
·
Qual 4.0
LoRA vs full FT on 7B + 10k examples: order of magnitude cost comparison
Short Answer
Medium
·
Qual 4.0