Retrieval / Validity
verifiedGrounding
Retrieval is not only about finding the right passage; it is about the answer actually resting on it. A model handed a correct passage can still answer from memory, contradict what it was given, or cite it for something it does not say. Grounding is the property that each claim traces to something retrieved, and it has to be checked rather than assumed.
Two failure modes needing different fixes: the passage is missing, which is a retrieval problem, or the passage is present and unused, which is not. Long contexts make the second worse — a relevant passage in the middle of a long context is used measurably less than the same passage at either end. Asking for per-claim citations makes the failure visible rather than preventing it.
Retrieval quality bounds answer quality without determining it. With recall r of the supporting passage and probability g that the model uses it when present, end-to-end accuracy is at most r·g — so a system reporting recall alone has reported the first factor and said nothing about the second.
grounded-claims holds 75% of the budget; rest holds the remaining 25%.
Claims in an answer that trace to a retrieved passage against those that do not. Drag the grounded count to watch the unsupported share shrink.
Reviewed by opendroid · 2026-08-04
- arXiv:2005.11401 — Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- arXiv:2307.03172 — Lost in the Middle: How Language Models Use Long Contexts