Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Autoregressive Decoding
Autoregressive Decoding
Subtopic
8 questions
Questions tagged with Autoregressive Decoding — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Walk through KV-cache updates when speculative decoding rejects some draft tokens
Short Answer
Medium
·
Qual 4.0
During decode, why is only Q computed for the new token while full K and V come from cache?
Multiple Choice
Easy
·
Qual 4.0
Why does a small FT dramatically improve strict-JSON output?
Short Answer
Medium
·
Qual 4.0
What exactly does the KV cache store and what computational redundancy does it eliminate?
Short Answer
Medium
·
Qual 4.0
Why does autoregressive generation use a KV cache?
Short Answer
Medium
·
Qual 4.0
What does the KV cache store, and why does it avoid Q?
Multiple Choice
Medium
·
Qual 4.0
In LLM serving, what is the primary driver of end to end latency for a generation request?
Multiple Choice
Medium
·
Qual 4.7
Meta
NVIDIA
What is the KV cache in transformer inference?
Flashcard
Easy
·
Qual 4.7