Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Nan
Nan
Subtopic
2 questions
Questions tagged with Nan — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
A DPO run spikes to NaN around step 400 after a clean start: explain the most likely cause
Short Answer
Medium
·
Qual 4.0
Predict what softmax produces when every key in a row is masked out.
Spot the Error
Medium
·
Qual 4.0