Cot Judge Prompts

Pick the statement that best describes a scoring rubric in LLM evaluation.

Before running LLM-as-judge, someone insists on writing a rubric first. What is a rubric in this context?

Spot the design flaws in this LLM evaluation rubric

Which properties characterize a well-designed LLM eval rubric?

Explain G-Eval's mechanism and why it improves over direct-score LLM judges

What is G-Eval and how does it differ from a direct-score LLM judge?

Why do anchor examples in an LLM judge prompt dramatically reduce score variance?

How does a chain-of-thought judge differ from a direct-score judge, and when is each better?

What is the primary advantage of chain-of-thought (CoT) judge prompts over direct-score prompts?