How Retrieval-Augmented Generation Is Rewiring What AI Knows

Large language models have dazzled the world with their fluency, yet they carry a hidden flaw: everything they know is frozen into their parameters at training time. Ask about events from last week, request a citation for a legal claim, or probe an obscure medical guideline, and the model may confidently invent an answer. A comprehensive survey published in Artificial Intelligence Review by researchers at Northwestern Polytechnical University in China maps how a technique called retrieval-augmented generation, or RAG, has become the leading remedy, tracing its evolution from a simple retrieve-then-read pipeline into adaptive, self-correcting, and agentic systems that are reshaping how machines access and produce knowledge.

The core problem RAG addresses is well understood. Because large language models rely on static parametric knowledge, they suffer from knowledge staleness, hallucinations, limited domain adaptability, weak traceability, and high updating costs in knowledge-intensive scenarios. Retraining a model to refresh its facts is expensive and slow, and even the largest models cannot guarantee that every generated sentence is grounded in verifiable evidence. RAG sidesteps this by pulling relevant documents from an external knowledge source at inference time and feeding them into the generation process, improving factual grounding, knowledge timeliness, and evidence traceability without touching a single model weight.

The new survey, led by Xiaoling Shu, Xiao Zhang, Ruixin Wang, Ziyi Yang, Xiaonan Zhao, and Shujie Han, organizes the field along three major dimensions: the system stack and paradigm evolution of RAG, evaluation methods and application evidence, and practical deployment and security challenges. Using a structured and transparent review protocol, the authors screened studies that proposed, improved, evaluated, or applied RAG-related methods, excluding work that merely touched on prompting or fine-tuning without retrieval or external evidence use. The result is a taxonomy-oriented, evaluation-aware, and deployment-conscious reference intended to give researchers and practitioners a systematic map of a field that has become increasingly fragmented across architectures, strategies, benchmarks, and risks.

At the heart of every RAG system lies the retriever, and the survey dissects the mathematical machinery behind it with unusual rigor. Sparse retrieval methods such as BM25 score documents through term frequency and inverse document frequency, rewarding exact lexical matches while remaining efficient and interpretable. Dense retrieval takes a different route, encoding queries and documents into continuous vectors with dual encoders and ranking them by dot product or cosine similarity, which excels at semantic matching when the query and the relevant document use different wording. Hybrid retrieval fuses both signals through weighted combinations with score normalization, a pattern the authors identify as especially valuable in enterprise question answering, legal documents, and technical manuals where both precise terminology and semantic relevance matter.

Beyond these foundations, the survey catalogues a family of retrieval-enhancement patterns that mark the field’s maturation. Graph-based retrieval represents knowledge as entities, edges, and relation types, scoring candidate paths by relation relevance, node relevance, and path coherence to support multi-hop reasoning over knowledge graphs. Iterative retrieval refines queries through multiple retrieval-generation cycles; recursive retrieval decomposes complex questions into sub-queries; adaptive retrieval adjusts retrieval depth based on intermediate feedback; and self-corrective retrieval evaluates its own evidence and regenerates when quality falls short. Neuro-symbolic retrieval combines neural semantic matching with rule-based constraints, while retrieval-augmented reasoning fetches evidence for intermediate reasoning steps rather than retrieving once before generation. Together, these templates show how retrieval has shifted from a one-shot preprocessing step to an active, dynamic component of reasoning itself.

The survey frames the field’s evolution as a progression from Naive RAG to Agentic RAG. Early systems simply retrieved passages and appended them to the prompt, emphasizing context relevance, answer relevance, and faithfulness. Later methods grew modular, graph-enhanced, self-corrective, multimodal, and increasingly agentic, with capability orientations shifting toward information integration, noise robustness, negative rejection, counterfactual reasoning, and deployment-oriented control. A central theoretical insight formalized in the survey’s appendix captures why retrieval quality dominates: answer quality is bounded by a function of retrieval recall, evidence use, and generation ability, meaning that even a powerful generator will fail if the retriever supplies insufficient, irrelevant, or unreliable evidence.

Measurement receives equally careful treatment. The survey assembles a multi-dimensional evaluation framework spanning retrieval metrics such as Precision@K, Recall@K, Hit Rate@K, mean reciprocal rank, mean average precision, and normalized discounted cumulative gain; generation metrics including exact match, accuracy, BLEU, and ROUGE-L; and semantic similarity measures like BERTScore and cosine similarity. Crucially, it goes beyond surface overlap to faithfulness and attribution metrics that check whether generated claims are actually supported by retrieved evidence, alongside robustness measures for noise, counterfactual evidence, and the ability to refuse unanswerable questions. Deployment-oriented metrics covering latency, retrieval cost, and end-to-end cost round out the framework, reflecting the reality that a RAG pipeline’s expense spans embedding, indexing, search, reranking, generation, verification, and tool calls.

Stress-testing emerges as a recurring theme. The survey examines evaluation protocols designed to probe whether systems remain reliable under noisy, incomplete, contradictory, or unanswerable conditions, and it synthesizes benchmark datasets covering open-domain question answering, multi-hop reasoning, fact verification, dialogue, summarization, information extraction, structured knowledge access, domain-specific QA, and dynamic evaluation. The authors caution that because different studies use different datasets, metrics, and experimental settings, their capability mapping of representative methods should be read as a qualitative synthesis rather than a strict statistical ranking, particularly for very recent work where only preprints may be available.

The survey’s most sobering contribution may be its treatment of security. As RAG systems are deployed in real environments, they inherit a distinctive attack surface: prompt injection can hijack the generation process, data poisoning can corrupt the knowledge base, retrieval hijacking can manipulate which evidence surfaces, privacy leakage can expose sensitive documents, and citation laundering can lend false credibility to fabricated claims by attaching plausible-looking references. By cataloguing these emerging risks alongside defensive mechanisms, the survey makes the case that RAG security deserves the same systematic attention as RAG capability, a point that will resonate as enterprises move from pilots to production.

For a technique that began as a pragmatic workaround for static model knowledge, retrieval-augmented generation has grown into a defining architecture of applied artificial intelligence, and this survey captures that trajectory with rare breadth and precision. By connecting paradigm evolution, component-level analysis, benchmark synthesis, application distribution, evaluation frameworks, and deployment and security analysis in a single coherent reference, the work offers both newcomers a structured entry point and practitioners a checklist of what mature RAG systems must now demonstrate: not just fluent answers, but grounded, traceable, robust, and safe ones. As the boundary between retrieval and generation continues to blur, the questions the survey raises about evaluation, cost, and trust are likely to define the next chapter of the field.

Subject of Research: Retrieval-augmented generation architectures, evaluation, and security in large language models

Article Title: From knowledge retrieval to generation: a comprehensive study of RAG's architectures, evolution, and applications

Article References: Shu, X., Zhang, X., Wang, R., Yang, Z., Zhao, X., & Han, S. (2026). From knowledge retrieval to generation: a comprehensive study of RAG's architectures, evolution, and applications. Artificial Intelligence Review. https://doi.org/10.1007/s10462-026-11716-1

Image Credits: AI Generated

DOI: 10.1007/s10462-026-11716-1

Keywords: retrieval-augmented generation, large language models, RAG evaluation, agentic RAG, hallucination, knowledge retrieval, dense retrieval, BM25, prompt injection, data poisoning, knowledge-intensive tasks, Artificial Intelligence Review