Fresher / New Grad

Where does FP8 fit in modern LLM serving and which GPUs support it?

Match each 4-bit format to its niche in 2026 inference and fine-tuning.

FLOPs vs FLOP/s: fill in the counts versus rate distinction.

What is the EOS token and how does the runtime use it?

Describe what happens during the decode phase of LLM inference.

What is the context window of an LLM?

Walk through the shape of an OpenAI-compatible chat completions request and response.

Identify the B200 and GB200 NVL72 in NVIDIA's Blackwell lineup.

Describe what 'autoregressive' means for LLM generation.

What does arithmetic intensity actually measure and what does AI near 1 imply?

Define activation quantization and explain how W8A8 differs from weight-only quant.

Where does the NVIDIA A100 sit on the inference hardware ladder?

Recognize vLLM and the optimization that made it famous

Match TTFT and TPOT to the latency they measure during streaming

Spell out TensorRT-LLM and pinpoint its production differentiator

Name TGI's maintainer and its niche among serving stacks

Identify PagedAttention and the project it ships with

Expand MQA and state its KV-cache cost tradeoff

Pair HBM and SRAM with their roles on an inference GPU

Define GQA in transformer attention

Why does completion-only loss usually outperform full-sequence loss on the same SFT data?

Match each instruction dataset to its on-disk row shape.

Tulu instruction-tuning family: what is it and who publishes it?

Pick the most accurate one-sentence summary of the tokenizer's role in fine-tuning.

Teacher forcing during SFT: which description nails it?