Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
LLM Evaluation
/
RAG Eval Metrics
RAG Eval Metrics
Subtopic
12 questions
Questions tagged with RAG Eval Metrics — part of LLM Evaluation.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Which statements correctly describe the four RAGAS metrics?
Multi-select
Medium
·
Qual 4.0
Match each RAGAS metric to the specific RAG quality problem it detects
Match Pairs
Medium
·
Qual 4.0
What four metrics does the RAGAS paper propose and what does each measure?
Flashcard
Medium
·
Qual 4.0
Explain faithfulness vs answer relevance in RAG evaluation with concrete examples
Short Answer
Medium
·
Qual 4.0
Define faithfulness in RAG evaluation and distinguish it from answer relevance
Flashcard
Easy
·
Qual 4.0
Explain context recall in RAG evaluation and why it is more expensive than context precision
Short Answer
Hard
·
Qual 4.0
What does context recall measure in RAG eval and what ground truth does it require?
Multiple Choice
Medium
·
Qual 4.0
What does context precision measure in RAG evaluation and what does low context precision indicate?
Multiple Choice
Medium
·
Qual 4.0
Predict what slice-level eval reveals about an 85% faithful RAG system suspected to fail on multi-hop queries
Predict Output
Hard
·
Qual 4.0
Compare Promptfoo, DeepEval, and LangSmith as LLM eval frameworks: when to use each?
Short Answer
Hard
·
Qual 4.0
Clarify the relationship between unfaithfulness and hallucination in RAG systems
Short Answer
Hard
·
Qual 4.0
Is 'unfaithful' the same as 'hallucinated'? What is the relationship between these concepts?
Multiple Choice
Medium
·
Qual 4.0