Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Self Vs Cross
Self Vs Cross
Subtopic
3 questions
Questions tagged with Self Vs Cross — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Explain when an architecture uses cross-attention vs self-attention. Give concrete examples.
Short Answer
Medium
·
Qual 4.0
Which modern LLM architecture uses cross-attention?
Multiple Choice
Medium
·
Qual 4.0
In self-attention, where do Q, K, and V come from? In cross-attention?
Multiple Choice
Medium
·
Qual 4.0
Microsoft