A colleague claims their model is 'grounded' because it cites sources. Explain why citation presence alone does not prove factual grounding.
Citation presence shows the model learned to reference sources but does not prove the cited content supports the claim. Faithfulness metrics verify claim level entailment.
Imagine a student who writes a history essay and puts footnotes at the end of every sentence. The teacher is impressed until she checks the footnotes. One footnote points to a real book but gets the date wrong. Another points to a book that does not exist. The student learned that essays should have footnotes, but the footnotes do not actually back up the claims. A grounded model is like a student whose footnotes actually say what the essay claims they say. Checking that takes more work than counting footnotes.
Detailed answer & concept explanation~4 min readEverything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example.
Everything important, quickly.
Open with the framing that citation is formatting behavior, grounding is a semantic property. Name the two fabrication modes: real paper with wrong findings, and nonexistent paper. Walk through how faithfulness metrics (RAGAS, FActScore) decompose output into atomic claims and check entailment. Cover why RAG systems are especially vulnerable. Close on the production discipline: measure faithfulness directly, treat citation count as necessary but not sufficient.
Real products, models, and research that use this idea.
- RAGAS (Retrieval Augmented Generation Assessment) is widely used in production RAG pipelines to score faithfulness by decomposing outputs into claims and checking entailment against retrieved context.
- FActScore evaluates long form generation by breaking output into atomic facts and verifying each against a knowledge source, catching misattributed citations that surface level checks miss.
- Vectara's Hughes Hallucination Evaluation Model scores faithfulness in RAG systems and is used as a leaderboard metric for grounding quality across model providers.
- Google Vertex AI search includes a grounding score in its RAG API response that checks entailment between the generated answer and the retrieved passages, not just citation presence.
What an interviewer would ask next. Try answering before peeking at the approach.
QYour RAG system scores 0.92 on RAGAS faithfulness but users still report hallucinations. What could explain the gap?
QHow would you evaluate grounding in a system that does not cite sources at all, just generates answers from retrieved context?
Don't say thisRed flags and common mistakes that signal junior thinking. Click to expand.
Red flags and common mistakes that signal junior thinking. Click to expand.
Equating citation count with grounding quality, when models routinely fabricate references or misattribute findings to real papers.
The night-before-the-interview bullets. Scan these on the way to the call.
Primary sources. Skim if you want the original framing.
Same topic, related formats. Practice these next.