Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Prefix Cache
Prefix Cache
Subtopic
6 questions
Questions tagged with Prefix Cache — part of Inference Optimization.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
When does inflating the system prompt actually lower cost per call?
Short Answer
Medium
·
Qual 4.0
Anthropic
A teammate randomized system prompts per user and expects the prompt cache to still help, what's wrong?
Spot the Error
Medium
·
Qual 4.0
Walk through how a prefix-cache hit changes the work that chunked prefill has to do
Short Answer
Medium
·
Qual 4.0
Prefix-cache hit lands on a request: does speculative decoding still help that request?
Short Answer
Medium
·
Qual 4.0
You change one word in the system prompt and prompt caching breaks. Why?
Flashcard
Easy
·
Qual 4.0
What is RadixAttention in SGLang and how does it differ from vLLM's prefix sharing?
Short Answer
Hard
·
Qual 4.0