Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Fine-Tuning
/
Distributed Training
Distributed Training
Subtopic
3 questions
Questions tagged with Distributed Training — part of Fine-Tuning.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
DDP vs FSDP for a 13B full fine-tune on 4xA100-40GB: which is feasible?
Multiple Choice
Medium
·
Qual 4.0
Accelerate launch: what does that one CLI actually wire up?
Flashcard
Easy
·
Qual 4.0
Match multi-GPU training strategy to what it shards
Match Pairs
Hard
·
Qual 4.0