Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Output Projection
Output Projection
Subtopic
4 questions
Questions tagged with Output Projection — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Describe the W_O projection in multi-head attention, its shape and what it mixes.
Flashcard
Easy
·
Qual 4.0
Beyond shape preservation, name two things W_O does after head concat
Short Answer
Medium
·
Qual 4.0
After W_O projects the multi-head output back to d_model, what happens before the next sub-layer runs?
Multiple Choice
Easy
·
Qual 4.0
Define a single attention head, what does one head actually own and produce?
Flashcard
Easy
·
Qual 4.0