GLOSSARY

An AI architecture that combines large language model generation with real-time retrieval from external knowledge sources to produce grounded, verifiable responses.

RAG reduces hallucination risk in production AI systems by anchoring outputs in verifiable source material. For organisations deploying customer-facing AI, internal knowledge assistants, or compliance-sensitive automation, RAG provides an auditable chain from query to source to response. This makes AI outputs more trustworthy for decision-making, reduces the cost of fine-tuning by leveraging existing knowledge bases, and enables real-time knowledge updates without retraining.

A professional services firm deploys a RAG-based internal assistant that retrieves from their policy documentation, regulatory filings, and project history. When a consultant queries "What are our data retention obligations for EU clients?", the system retrieves the relevant clauses from stored GDPR compliance documents and generates a response citing specific policy sections.

RAG quality depends heavily on the relevance and completeness of the retrieval corpus. Poor chunking strategies, stale indexes, or semantic gaps between queries and stored documents can produce incomplete or misleading results. RAG does not eliminate hallucination — it reduces it. The retrieval step adds latency and infrastructure complexity compared to direct model inference.

Retrieval-Augmented Generation embeds a retrieval step into the inference pipeline of a large language model. When a query is received, a retrieval component searches an external corpus — typically a vector database or document index — for semantically relevant passages. These passages are injected into the model's context window alongside the original query, enabling the model to generate responses that reference specific, up-to-date information rather than relying solely on its parametric memory. Key architectural components include the embedding model, vector store, retrieval strategy (dense, sparse, or hybrid), re-ranking layer, and the generation model itself.