Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Premium
/
Pretraining
Premium
Pretraining
Premium questions for this topic. Unlock with Pro to study the full set.
18 questions
Unlock with Pro
01
Premium
State the Chinchilla compute…
Short Answer
Medium
04
Premium
Where does pretraining quality…
Short Answer
Medium
11
Premium
Debug 22% MFU on…
Short Answer
Medium
13
Premium
Diagnose whether a transient…
Short Answer
Medium
14
Premium
Perplexity limits: which model…
Short Answer
Medium
17
Premium
Defend a WSD schedule…
Short Answer
Medium
18
Premium
Why overtrain a smaller…
Short Answer
Hard
02
Premium
Match Kaplan era and…
Match Pairs
Medium
10
Premium
Match DDP, FSDP, and…
Match Pairs
Medium
03
Premium
Spot the hidden systems…
Spot the Error
Hard
06
Premium
Spot the flaws in…
Spot the Error
Medium
05
Premium
When does n-gram dedup…
Multiple Choice
Medium
07
Premium
Why do corpus mixture…
Multiple Choice
Medium
08
Premium
What fails when synthetic…
Multiple Choice
Hard
09
Premium
Choose where 50B premium…
Multiple Choice
Medium
12
Premium
Does bf16 pretraining still…
Multiple Choice
Medium
15
Premium
Why does SFT struggle…
Multiple Choice
Medium
16
Premium
When continued pretraining beats…
Multiple Choice
Medium