Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Prefix Cache
Prefix Cache
Subtopic
6 questions
Questions tagged with Prefix Cache — part of Inference Optimization.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
When does inflating the system prompt actually lower cost per call?
Short Answer
Medium
A teammate randomized system prompts per user and expects the prompt cache to still help, what's wrong?
Spot the Error
Medium
Walk through how a prefix cache hit changes the work that chunked prefill has to do
Short Answer
Medium
Prefix cache hit lands on a request: does speculative decoding still help that request?
Short Answer
Medium
You change one word in the system prompt and prompt caching breaks. Why?
Flashcard
Easy
What is RadixAttention in SGLang and how does it differ from vLLM's prefix sharing?
Short Answer
Hard
Anthropic
Coinbase
Flowise
Krutrim
Ai21
Airbnb
Amd
Midjourney
Browserbase
Cognizant
Harvey
Kpmg