What four metrics does the RAGAS paper propose and what does each measure?

Attempt it

RAGAS (Retrieval Augmented Generation Assessment) proposes four complementary metrics: (1) Faithfulness: are answer claims entailed by the retrieved context? (2) Answer relevance: does the answer address the user's question? (3) Context precision: what fraction of retrieved chunks are relevant to the question? (4) Context recall: what fraction of reference-answer claims are covered by retrieved context? Together they cover retrieval quality (precision, recall) and generation quality (faithfulness, relevance).

Your answer

Quick reference

TL;DR

RAGAS scores a RAG pipeline on four axes: faithfulness and answer relevance for generation, context precision and context recall for retrieval. Three are reference-free.

Memory aid

Sign in for the mnemonic that makes this stick. See Pro pricing.

Easy to grasp

Imagine grading a student's open-book essay. You check four things. Did every claim in the essay actually come from the books they were allowed to use, or did they make stuff up (faithfulness)? Did the essay actually answer the question asked, or wander off (answer relevance)? Of the books they pulled off the shelf, how many were actually useful versus random clutter (context precision)? And did they pull every book they needed, or miss one that held a key fact (context recall)? The clever part is that for three of these you do not even need a teacher's model answer. You only need a model answer to check the last one, recall, because you cannot know what was missed without knowing what should have been there.

Key concepts

RAGAS Faithfulness Answer relevance Context precision and recall

Detailed answer & concept explanation

~8 min read

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example.

Sign in for 5 free unlocks/day or go Pro for unlimited. See Pro pricing.

Quick scan · 2–4 min

Everything important, quickly.

5 min: name the four metrics, map two to generation and two to retrieval, explain the reference-free property and why recall is the exception, then cover the mechanics of faithfulness and answer relevance and the LLM-judge limitations.

Real-world examples

Real products, models, and research that use this idea.

RAGAS is the default RAG-eval library on LlamaIndex and LangChain pipelines, exposing faithfulness and context-recall scorers out of the box.
Teams run RAGAS faithfulness and answer relevance on live traffic with Claude Opus 4.7 or GPT-5.5 as the judge because those two are reference-free.
TruLens ships an equivalent RAG triad (groundedness, answer relevance, context relevance) that mirrors three of the four RAGAS metrics.
Arize Phoenix and Langfuse both integrate RAGAS metrics into their RAG observability dashboards for production monitoring.
Context recall is typically computed offline against a curated 200-to-500-example reference set since it alone requires ground-truth answers.

Interviewer follow-ups

What an interviewer would ask next. Try answering before peeking at the approach.

QWhy is context recall the only RAGAS metric that requires a reference answer?

Sign in or go Pro to see the approach for this follow-up.

QHow does faithfulness avoid the failure mode of a holistic LLM-judge rating?

Sign in or go Pro to see the approach for this follow-up.

QIf faithfulness is high but answer relevance is low, what is wrong with the pipeline?

Sign in or go Pro to see the approach for this follow-up.

QWhat are the limitations of using LLM-judge-based RAGAS metrics at scale?

Sign in or go Pro to see the approach for this follow-up.

Don't say this

Red flags and common mistakes that signal junior thinking. Click to expand.

Most common mistake

Treating all four RAGAS metrics as reference-free. Only context recall needs a ground-truth answer; the other three score the pipeline without any human label.

Sign in or go Pro to see all red flags and common mistakes. See Pro pricing.

60-second cheat sheet

The night-before-the-interview bullets. Scan these on the way to the call.

Sign in for 5 unlocks/day or go Pro for unlimited revision sheets. See Pro pricing.

References

Primary sources. Skim if you want the original framing.

Es et al., RAGAS: Automated Evaluation of Retrieval Augmented Generation