Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Memory Bound
Memory Bound
Subtopic
4 questions
Questions tagged with Memory Bound — part of Inference Optimization.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Each decode step loads ___ from HBM, regardless of how many tokens have already been generated
Fill in Blank
Easy
FLOPs vs FLOP/s: fill in the counts versus rate distinction.
Fill in Blank
Easy
What is the arithmetic intensity of an LLM decode step and why is it close to 1?
Short Answer
Hard
Premium
Why is standard attention…
Multiple Choice
Hard
Meesho
Robust Intelligence
Ada
Comet Ml
NVIDIA
Pinterest
Harvey
Weaviate