Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Inference Optimization/Memory Bandwidth

Memory Bandwidth

Subtopic9 questions

Questions tagged with Memory Bandwidth — part of Inference Optimization.

Premium questions for this topic

Sort

Questions

Speculative decoding is already on and batch size just climbed to 64, keep it or kill it?
Multiple ChoiceMedium
PremiumHow tensor parallelism shards…
Short AnswerMedium
What unit measures GPU memory bandwidth and why does that number cap decode speed?
FlashcardEasy
What does arithmetic intensity measure and what does AI near 1 imply?
FlashcardEasy
Pair HBM and SRAM with their roles on an inference GPU
Match PairsEasy
Why is decode phase attention memory bandwidth bound when the model generates one token at a time?
Short AnswerMedium
Why does prefill saturate compute while decode is bottlenecked on memory bandwidth?
Short AnswerMedium
Where does FlashAttention deliver the biggest serving speedup?
Multiple ChoiceMedium
In LLM serving, what is the primary driver of end to end latency for a generation request?
Multiple ChoiceMedium

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Descript Mongodb

Fireworks Ai NVIDIA

NVIDIA Rephrase Ai

Harvey Weaviate

Modal Labs NVIDIA

Fireworks Ai Jpmorgan

Lepton Ai Typeface

Jasper Servicenow