Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Metrics
Metrics
Subtopic
9 questions
Questions tagged with Metrics — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
TTFT: name the metric it captures and what dominates it
Flashcard
Easy
·
Qual 4.0
In benchmarks, tokens per second measures what exactly?
Flashcard
Easy
·
Qual 4.0
Throughput, for an LLM serving system: give the working definition
Flashcard
Easy
·
Qual 4.0
Pick the best definition: in LLM evaluation, a metric is _____.
Multiple Choice
Easy
·
Qual 4.0
A teammate asks what 'running evals' means in the LLM context. How would an engineer explain it without jargon?
Flashcard
Easy
·
Qual 4.0
What metrics would you instrument to evaluate the health of a production MCP integration?
Short Answer
Hard
·
Qual 4.0
What does a rising approval-rejection ratio signal in a production MCP integration?
Multiple Choice
Medium
·
Qual 4.0
Explain why string-match accuracy is systematically misleading for LLM evaluation
Short Answer
Medium
·
Qual 4.0
Why string-match accuracy fails as an LLM evaluation metric
Flashcard
Easy
·
Qual 4.0