Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Optimizer State
Optimizer State
Subtopic
4 questions
Questions tagged with Optimizer State — part of Fine-Tuning.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Order the pieces of state that must be restored to resume a training run bit exactly
Order Steps
Medium
Which of these is actually saved when a fine-tuning checkpoint is written?
Multiple Choice
Easy
Adam optimizer state per parameter: fill in the moment buffers and bytes
Fill in Blank
Easy
LoRA vs full FT on 7B + 10k examples: order of magnitude cost comparison
Short Answer
Medium
Intuit
Weaviate
Haptik
IBM
Modal Labs
Pinterest
Ey
NVIDIA