Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Qkv Projections
Qkv Projections
Subtopic
6 questions
Questions tagged with Qkv Projections — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Why split V from K instead of just reusing K as the value vector?
Multiple Choice
Easy
·
Qual 4.0
Each row of the post-softmax attention weight matrix corresponds to which side of the QK product?
Fill in Blank
Easy
·
Qual 4.0
Tying K and V to one projection, what is gained and what is risked?
Multiple Choice
Medium
·
Qual 4.0
Inside a T5-style encoder-decoder, which sub-layer reads the encoder outputs, and through which projection?
Multiple Choice
Easy
·
Qual 4.0
Walk through how a token's d_model embedding is split into per-head pieces inside multi-head attention.
Multiple Choice
Easy
·
Qual 4.0
What does the dot product q . k actually measure inside an attention layer?
Flashcard
Easy
·
Qual 4.0