Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Memory Fragmentation
Memory Fragmentation
Subtopic
4 questions
Questions tagged with Memory Fragmentation — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
vLLM defaults to a page size of 16. Pick what makes 1 and 1024 worse choices.
Multiple Choice
Medium
·
Qual 4.0
What problem does PagedAttention solve and why does block-based allocation enable larger batches?
Short Answer
Hard
·
Qual 4.0
What is the primary mechanism by which PagedAttention increases serving throughput?
Multiple Choice
Medium
·
Qual 4.0
What problem does paged attention (vLLM) solve, and what OS concept does it borrow from?
Multiple Choice
Hard
·
Qual 4.0