Cot Judge Prompts

Pick the statement that best describes a scoring rubric in LLM evaluation.

Before running LLM-as-judge, someone insists on writing a rubric first. What is a rubric in this context?

PremiumSpot the design flaws…

Which properties characterize a well designed LLM eval rubric?

Explain G-Eval's mechanism and why it improves over direct score LLM judges

What is G-Eval and how does it differ from a direct score LLM judge?

Why do anchor examples in an LLM judge prompt dramatically reduce score variance?

How does a chain-of-thought judge differ from a direct score judge, and when is each better?

What is the primary advantage of chain-of-thought (CoT) judge prompts over direct score prompts?