Explain context recall in RAG evaluation and why it is more expensive than context precision
Explain what context recall measures in RAG evaluation, how it is computed, what ground truth it requires, and why that requirement makes it more operationally expensive than context precision.
Context recall is the fraction of reference-answer claims that the retrieved chunks support. It needs a gold answer per query, which makes it costlier than reference-free context precision.
Imagine an open-book exam. The retriever's job is to flip to the right pages before the model writes its answer. Context recall asks: of all the facts the perfect answer needs, how many were actually on the pages we opened? To grade that, you need the perfect answer written down in advance, then you check each fact against the open pages. That perfect answer is the expensive part: someone has to write or curate it for every single question. Context precision is cheaper because it only asks 'are the pages we opened on-topic?' You can eyeball that without knowing the perfect answer at all. So recall tells you what you missed, but only if you already paid someone to define what 'complete' means.
Detailed answer & concept explanation~8 min readEverything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example.
Everything important, quickly.
5 min: define recall as reference-answer coverage, walk the claim-attribution computation, contrast with reference-free precision, explain the annotation cost gap and the pipeline-ceiling argument, then cover bootstrapping a gold set.
Real products, models, and research that use this idea.
- RAGAS computes context recall by claim-level attribution against a ground-truth answer, and ships synthetic test-set generation to bootstrap that gold set.
- TruLens reports context relevance (a precision-style, reference-free signal) separately from groundedness, reflecting the same cost asymmetry.
- LangSmith and Braintrust let teams attach reference outputs to a dataset so recall-style evals can run alongside reference-free relevance scoring.
- Production RAG teams using Claude Opus 4.7 or GPT-5.5 as the judge run reference-free precision on live logs but reserve recall for a curated holdout.
- Patronus and Arize Phoenix surface retrieval recall as the upstream ceiling when diagnosing why answer-correctness regressed.
What an interviewer would ask next. Try answering before peeking at the approach.
QHow would you bootstrap a labelled gold set for context recall without months of manual annotation?
QWhy does low context recall cap the entire RAG pipeline, and how does that change debugging order?
Don't say thisRed flags and common mistakes that signal junior thinking. Click to expand.
Red flags and common mistakes that signal junior thinking. Click to expand.
Confusing recall with precision, or claiming both are reference free. Context recall needs a gold answer per query to define what complete retrieval looks like, and that annotation cost is the whole point.
The night-before-the-interview bullets. Scan these on the way to the call.
Primary sources. Skim if you want the original framing.
Same topic, related formats. Practice these next.