Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Judge Calibration
Judge Calibration
Subtopic
5 questions
Questions tagged with Judge Calibration — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Order the three eval approaches from cheapest/fastest to most expensive/slowest
Order Steps
Medium
·
Qual 4.0
What is LLM-as-judge and why did it emerge as an evaluation approach?
Flashcard
Easy
·
Qual 4.0
Design an LLM judge prompt with anchor examples and explain how they reduce score variance
Short Answer
Hard
·
Qual 4.0
Why do anchor examples in an LLM judge prompt dramatically reduce score variance?
Multiple Choice
Medium
·
Qual 4.0
How does a chain-of-thought judge differ from a direct-score judge, and when is each better?
Short Answer
Medium
·
Qual 4.0