Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Home
/
Roles
/
LLMOps Engineer
LLMOps Engineer
328 questions
Serves, scales, and monitors LLM systems, capacity, latency, observability, rollouts, on-call.
Topics
Format
Difficulty
Companies
Track
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Does asking for top-k logprobs add real compute cost per token, or only bytes on the wire?
Short Answer
Medium
·
Qual 4.0
OpenAI
Greedy decoding and temperature sampling: does one cost more per token than the other?
Short Answer
Medium
·
Qual 4.0
Pair KV-cache eviction and KV-quantization with the situation each one is the right answer for
Match Pairs
Medium
·
Qual 4.0
Walk through how CUDA graphs reshape per-step decode latency and when the win disappears
Short Answer
Medium
·
Qual 4.0
NVIDIA
Match EAGLE-3 and Medusa-2 to drafting mechanism, integration cost and acceptance behavior
Match Pairs
Medium
·
Qual 4.0
What is a tensor core and why does it dominate matmul throughput on GPUs?
Flashcard
Easy
·
Qual 4.0
The roofline model in plain language, without the chart, what is it saying?
Flashcard
Easy
·
Qual 4.0
TPM and RPM each throttle a different axis, which one caps which?
Match Pairs
Easy
·
Qual 4.0
NVLink vs PCIe: match each interconnect to its bandwidth tier in a modern multi-GPU server.
Match Pairs
Easy
·
Qual 4.0
A MIG slice on an H100, what is it and what is it good for?
Flashcard
Easy
·
Qual 4.0
What unit measures GPU memory bandwidth and why does that number cap decode speed?
Flashcard
Easy
·
Qual 4.0
Identify the NVIDIA H100: what generation, what memory, what tensor-core formats?
Flashcard
Easy
·
Qual 4.0
Where does FP8 fit in modern LLM serving and which GPUs support it?
Flashcard
Easy
·
Qual 4.0
Match each 4-bit format to its niche in 2026 inference and fine-tuning.
Match Pairs
Easy
·
Qual 4.0
FLOPs vs FLOP/s: fill in the counts versus rate distinction.
Fill in Blank
Easy
·
Qual 4.0
Identify the B200 and GB200 NVL72 in NVIDIA's Blackwell lineup.
Flashcard
Easy
·
Qual 4.0
Where does the NVIDIA A100 sit on the inference hardware ladder?
Flashcard
Easy
·
Qual 4.0
Why does a reasoning model like DeepSeek V4 quietly inflate the output-token bill?
Short Answer
Medium
·
Qual 4.0
Which components dominate cold-start latency when a serving replica spins up?
Multi-select
Medium
·
Qual 4.0
Pick Claude Sonnet 4.6 over Opus 4.7, when is that the right call?
Multiple Choice
Medium
·
Qual 4.0
Anthropic
Trace how one slow request stalls every co-batched generation step.
Short Answer
Medium
·
Qual 4.0
Pick the workload where a provider's Batch API beats the realtime endpoint
Multiple Choice
Medium
·
Qual 4.0
Anthropic
OpenAI
Recognize vLLM and the optimization that made it famous
Flashcard
Easy
·
Qual 4.0
Match TTFT and TPOT to the latency they measure during streaming
Match Pairs
Easy
·
Qual 4.0
Spell out TensorRT-LLM and pinpoint its production differentiator
Flashcard
Easy
·
Qual 4.0
Showing 51–75 of 328
← Prev
Next →