Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Judge Calibration
Judge Calibration
Subtopic
5 questions
Questions tagged with Judge Calibration — part of LLM Evaluation.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Order the three eval approaches from cheapest/fastest to most expensive/slowest
Order Steps
Medium
What is LLM-as-judge and why did it emerge as an evaluation approach?
Flashcard
Easy
Design an LLM judge prompt with anchor examples and explain how they reduce score variance
Short Answer
Hard
Why do anchor examples in an LLM judge prompt dramatically reduce score variance?
Multiple Choice
Medium
How does a chain-of-thought judge differ from a direct score judge, and when is each better?
Short Answer
Medium
Accenture
Inflection Ai
Adobe
Airbnb
Anthropic
Doordash
Anthropic
Infosys
Anthropic
Workday