Beyond the Parameters: A Technical Survey of Contextual Enrichment in Large Language Models: From In-Context Prompting to Causal Retrieval-Augmented Generation

📅 2026-04-03
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
Large language models are constrained by static knowledge, limited context windows, and weak causal reasoning capabilities, hindering their effective use of external information. This work systematically reviews techniques that enhance model performance during inference through structured contextual augmentation, including in-context learning, prompt engineering, retrieval-augmented generation (RAG), graph-augmented RAG, and causal RAG. We propose a unified analytical framework that integrates literature synthesis, cross-study evidence aggregation, and claim auditing to distinguish high-confidence findings from emerging results. Building on this framework, we develop a deployment-oriented decision guide and release a prioritized research agenda for trustworthy retrieval-augmented NLP, offering systematic support for future research and practical applications.

Technology Category

Natural Language Processing: (Large) Language ModelsCognitive Modeling & Cognitive Systems: Conceptual Inference and ReasoningMachine Learning: Large Multimodal Models (LMMs)

Application Category

Search and Retrieval-Augmented AI: Retrieval-Augmented Generation (RAG) and multi-modal RAGSemantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMsUser Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
📝 Abstract
Large language models (LLMs) encode vast world knowledge in their parameters, yet they remain fundamentally limited by static knowledge, finite context windows, and weakly structured causal reasoning. This survey provides a unified account of augmentation strategies along a single axis: the degree of structured context supplied at inference time. We cover in-context learning and prompt engineering, Retrieval-Augmented Generation (RAG), GraphRAG, and CausalRAG. Beyond conceptual comparison, we provide a transparent literature-screening protocol, a claim-audit framework, and a structured cross-paper evidence synthesis that distinguishes higher-confidence findings from emerging results. The paper concludes with a deployment-oriented decision framework and concrete research priorities for trustworthy retrieval-augmented NLP.
Problem

Research questions and friction points this paper is trying to address.

static knowledge
finite context windows
causal reasoning
contextual enrichment
retrieval-augmented generation
Innovation

Methods, ideas, or system contributions that make the work stand out.

Contextual Enrichment
Retrieval-Augmented Generation
Causal Reasoning
Structured Context
Evidence Synthesis
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
P
Prakhar Bansal
S
Shivangi Agarwal