Log Probabilities
Also known as: Logprobs, Token probabilities
Per-token log probabilities from the model: confidence signal, eval input, and classification trick.
The log of the probability the model assigned to each generated token. Returned by most LLM APIs (logprobs flag). Useful for confidence scoring, eval, structured-output validation, and classification via constrained sampling.
In practice
Underrated production tool. Interviews probe using logprobs for confidence thresholds and as judges in evals.
Related topics
Questions that mention this term
Related terms
API LLM
An LLM accessed through a provider API: pay per token, get the frontier model, hand over ops.
Beam Search
Keep the K best partial sequences at each step; deterministic, breadth-first decoding.
Chatbot Arena
Crowdsourced blind A/B comparisons of LLM responses, aggregated into an Elo leaderboard.
Eval Harness
A framework for running, scoring, and tracking LLM evals over time; handles golden sets, judges, and regressions.
FlashAttention
A memory-aware attention kernel that's 2-4x faster than vanilla, with identical math.
GGUF
Self-contained binary format for quantized LLMs; the standard for llama.cpp / Ollama / LM Studio.