Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Prefill Decode
Prefill Decode
Subtopic
5 questions
Questions tagged with Prefill Decode — part of Inference Optimization.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Prefix cache hit lands on a request: does speculative decoding still help that request?
Short Answer
Medium
Premium
When does splitting prefill…
Short Answer
Medium
Why does prefill saturate compute while decode is bottlenecked on memory bandwidth?
Short Answer
Medium
Which workload trace shows the strongest case for disaggregated prefill/decode serving?
Multiple Choice
Hard
Premium
How does Sarathi-Serve's chunked…
Short Answer
Hard
Ai21
Airbnb
Graphcore
NVIDIA
Cognizant
Modal Labs
Microsoft
NVIDIA
Bcg
Modal Labs