Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Multi Query Attention
Multi Query Attention
Subtopic
3 questions
Questions tagged with Multi Query Attention — part of Inference Optimization.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Match MLA, GQA and MQA to their mechanisms, cache reduction and quality posture
Match Pairs
Hard
Match each attention variant to its KV-cache property and a production user
Match Pairs
Medium
For a 64-Q-head model with GQA group size G=8, how many K/V heads exist and what is the cache reduction vs MHA?
Short Answer
Medium
Accenture
Bytedance
Canva
Graphcore
Kpmg
Meta