Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Prefill Vs Decode
Prefill Vs Decode
Subtopic
5 questions
Questions tagged with Prefill Vs Decode — part of Inference Optimization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Which statement best explains why prefill and decode hit different bottlenecks on the same GPU?
Multiple Choice
Medium
·
Qual 4.0
NVIDIA
Why does prefill's O(seq^2) attention cost saturate compute rather than bandwidth?
Short Answer
Hard
·
Qual 4.0
NVIDIA
Spot the errors in this explanation of input vs output pricing
Spot the Error
Medium
·
Qual 4.0
Why are output tokens typically 3-5× more expensive than input tokens?
Short Answer
Medium
·
Qual 4.0
Anthropic
OpenAI
For a 200-token prompt and 1000-token completion, why does decode dominate end-to-end latency?
Short Answer
Medium
·
Qual 4.0