Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Multi Query Attention
Multi Query Attention
Subtopic
3 questions
Questions tagged with Multi Query Attention — part of Inference Optimization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Match MLA, GQA and MQA to their mechanisms, cache reduction and quality posture
Match Pairs
Hard
·
Qual 4.0
Match each attention variant to its KV-cache property and a production user
Match Pairs
Medium
·
Qual 4.0
For a 64-Q-head model with GQA group size G=8, how many K/V heads exist and what is the cache reduction vs MHA?
Short Answer
Medium
·
Qual 4.0