Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
Inter Rater Agreement
Inter Rater Agreement
Subtopic
3 questions
Questions tagged with Inter Rater Agreement — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Spot the design flaws in this LLM evaluation rubric
Spot the Error
Hard
·
Qual 4.0
When should you use Fleiss's kappa instead of Cohen's kappa in a human eval study?
Multiple Choice
Medium
·
Qual 4.0
Complete: Cohen's kappa >___ is 'substantial' agreement; >___ is 'almost perfect' agreement
Fill in Blank
Medium
·
Qual 4.0