Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Inference Optimization/Throughput

Throughput

Subtopic11 questions

Questions tagged with Throughput — part of Inference Optimization.

Premium questions for this topic

Sort

Questions

Decode reads the whole model to emit one token: what does that imply for batching?
Short AnswerHard
Explain how continuous batching keeps GPUs busy that static batching leaves idle
Short AnswerHard
In benchmarks, tokens per second measures what exactly?
FlashcardEasy
Throughput, for an LLM serving system: give the working definition
FlashcardEasy
Sequence packing: what it does, and the attention mask gotcha
Short AnswerHard
PremiumDefine TTFT, TPOT and…
Short AnswerMedium
A chatbot team reports TTFT P99 jumped from 300ms to 1.4s overnight. Which root cause is most likely?
Multiple ChoiceMedium
PremiumWhat is the primary…
Multiple ChoiceMedium
Spot the errors in this description of continuous batching
Spot the ErrorMedium
Why is batching the single biggest throughput lever for LLM decode?
Short AnswerMedium
PremiumWhat is the primary…
Multiple ChoiceMedium

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Glean Salesforce

Copy Ai Infosys

Coinbase NVIDIA

Netflix Niki Ai

Arize Ai Datadog

Braintrust Deloitte

Browserbase NVIDIA

Bytedance Roblox

Moveworks NVIDIA

Midjourney Mphasis