Self Preference Bias

Writing the LLM-as-judge prompt for an eval pipeline: name three biases to design against and one mitigation each.

Spot the flaw in this LLM evaluation setup that uses GPT-4 as judge

What is self-preference bias in LLM-as-judge setups?

Which statements correctly describe the benefits and limitations of a panel of judges eval setup?

How does a panel of judges setup reduce LLM-as-judge bias?

Which of these are valid concerns when using LLM-as-judge for evaluation?