Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Self Attention
Self Attention
Subtopic
6 questions
Questions tagged with Self Attention — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Encoder self-attention versus decoder self-attention, what is the single structural difference at the mask level?
Multiple Choice
Easy
·
Qual 4.0
Inside a T5-style encoder-decoder, which sub-layer reads the encoder outputs, and through which projection?
Multiple Choice
Easy
·
Qual 4.0
Walk through a T5 decoder block in order, list the attention sub-layers and what each one's Q, K, V read from.
Order Steps
Medium
·
Qual 4.0
Explain when an architecture uses cross-attention vs self-attention. Give concrete examples.
Short Answer
Medium
·
Qual 4.0
Which modern LLM architecture uses cross-attention?
Multiple Choice
Medium
·
Qual 4.0
In self-attention, where do Q, K, and V come from? In cross-attention?
Multiple Choice
Medium
·
Qual 4.0
Microsoft