Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Scheduler
Scheduler
Subtopic
4 questions
Questions tagged with Scheduler — part of Inference Optimization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Walk through how a prefix-cache hit changes the work that chunked prefill has to do
Short Answer
Medium
·
Qual 4.0
When does splitting prefill and decode onto separate replica pools actually pay off in production?
Short Answer
Medium
·
Qual 4.0
What does the vLLM-style continuous-batching scheduler actually do at each step?
Short Answer
Hard
·
Qual 4.0
Hugging Face
NVIDIA
Put the vLLM-style continuous-batching scheduler steps in correct order for one iteration
Order Steps
Hard
·
Qual 4.0
NVIDIA