Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Tensor Shapes
Tensor Shapes
Subtopic
2 questions
Questions tagged with Tensor Shapes — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Fill the blank: for a single head, QK^T has shape (T_query, ___).
Fill in Blank
Easy
·
Qual 4.0
Given Q of shape (B, n_heads, T, d_head), the per-head attention output before concatenation has shape ___.
Fill in Blank
Easy
·
Qual 4.0