Acronyms

Recognize vLLM and the optimization that made it famous

Match TTFT and TPOT to the latency they measure during streaming

Spell out TensorRT-LLM and pinpoint its production differentiator

Name TGI's maintainer and its niche among serving stacks

Identify PagedAttention and the project it ships with

Expand MQA and state its KV-cache cost tradeoff

Pair HBM and SRAM with their roles on an inference GPU

Define GQA in transformer attention