Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Inference Optimization
/
Hbm
Hbm
Subtopic
6 questions
Questions tagged with Hbm — part of Inference Optimization.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
What unit measures GPU memory bandwidth and why does that number cap decode speed?
Flashcard
Easy
Identify the NVIDIA H100: what generation, what memory, what tensor core formats?
Flashcard
Easy
Pair HBM and SRAM with their roles on an inference GPU
Match Pairs
Easy
Why is HBM bandwidth the binding constraint for LLM decode and how do you reason about the 'memory wall'?
Short Answer
Hard
Why does FlashAttention speed up serving even though it doesn't change the math?
Short Answer
Hard
Premium
Why is standard attention…
Multiple Choice
Hard
Fireworks Ai
Jpmorgan
Dataiku
LangChain
Jasper
Servicenow
NVIDIA
Turing
Fireworks Ai
NVIDIA
Harvey
Weaviate