systematic literature review

Structured synthesis of empirical and theoretical literature (including meta-analysis) to categorize models and methods, derive actionable design principles, and quantify prevalence of evaluation failures across studies.

systematicliteraturereview

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

From Literature to Insights: Methodological Guidelines for Survey Writing in Communications Research

Sep 30, 2025
DN
Dusit Niyato
🏛️ Nanyang Technological University | Memorial University | Queen’s University Belfast | Aristotle University of Thessaloniki | Friedrich-Alexander University Erlangen-Nurnberg

To address the lack of systematic methodologies for writing survey and tutorial papers in communications and networking, this paper—drawing on editorial experience from top-tier journals—proposes, for the first time, a seven-dimensional writing framework. It integrates literature synthesis, critical analysis, case-based pedagogy, and information visualization to establish a novel survey paradigm that balances tutorial utility with forward-looking insight. The framework systematically covers key stages: topic selection strategy, structural organization, diagrammatic design, and future research direction identification—emphasizing case-driven exposition and actionable insights. Empirical evaluation demonstrates that this roadmap substantially lowers the entry barrier for novice researchers, significantly enhancing survey papers’ readability, comprehension, and scholarly impact. It thus provides a reusable, methodologically grounded foundation for domain knowledge integration and dissemination.

Addressing challenges in writing high-quality communications survey papersEnabling junior researchers to craft impactful survey and tutorial articlesProviding systematic guidelines for literature synthesis in networking research

Must-Read Papers

Most classic and influential ideas
View more

This study addresses the tendency of systematic reviews to overgeneralize by overlooking fine-grained characteristics of included studies, thereby obscuring inter-study relationships and gaps in the literature. To mitigate this limitation, the authors propose an interactive evidence mapping approach that integrates large language models, topic modeling, and visualization techniques to automatically extract themes from heterogeneous review data and construct a dynamically explorable knowledge map. Validation through a scoping review on pedagogical agents in K–12 education demonstrates that this method transcends the constraints of traditional static summaries, substantially enhancing review transparency, effectively uncovering latent patterns and research gaps, and strengthening exploratory analytical capabilities.

evidence synthesisliterature visualizationovergeneralization

Facets, Taxonomies, and Syntheses: Navigating Structured Representations in LLM-Assisted Literature Review

Apr 25, 2025
RF
Raymond Fok
🏛️ University of Washington | Allen Institute for AI

Large-scale literature reviews face significant challenges in automated deep analysis and synthesis due to insufficient semantic understanding and structural reasoning capabilities. To address this, we propose DimInd, an interactive system introducing a novel hierarchical compression-based structured representation framework. It unifies paper-level understanding, multi-dimensional comparison, conceptual categorization, and narrative synthesis into a traceable, progressive workflow: papers → comparative tables → conceptual taxonomy → narrative review. DimInd integrates prompt engineering, structured information extraction, hierarchical clustering modeling, and interactive visualization, leveraging large language models (LLMs) for end-to-end semantic parsing and organization. In evaluations with 23 researchers, DimInd significantly reduced cognitive load in information extraction and conceptual organization compared to a ChatGPT baseline, while improving review construction efficiency and structural coherence. It is the first system to enable automated, deep, and narratively coherent synthesis for large-scale scholarly corpora.

Facilitates synthesis of large paper collections for literature reviewsProvides structured representations to guide literature understandingReduces manual effort in organizing and analyzing research papers

The Shiny Scary Future of Automated Research Synthesis in HCI

Jan 27, 2025
KR
Katja Rogers
🏛️ University of Amsterdam

This paper addresses reliability concerns and human-centered boundaries in the automated application of large language models (LLMs) for systematic literature reviews (SLRs) in Human-Computer Interaction (HCI). Method: Through empirical LLM experiments, human-AI collaborative workflow design, and HCI methodology analysis, it systematically delineates review stages amenable to automation (e.g., initial screening) versus those requiring human agency (e.g., thematic modeling, cross-study inference). Contribution/Results: The study proposes the “human-centered augmentation” ethical framework, rigorously defining LLMs’ capabilities and limitations in research synthesis. It delivers actionable, rigor-preserving guidelines for SLR practitioners and has been selected for a spotlight discussion at CHI ’25.

Human Expertise PreservationLLMs AssistanceResearch Integrity

PERELMAN: Pipeline for scientific literature meta-analysis. Technical report

Dec 25, 2025
DS
Daniil Sherki
🏛️ AI4Science Center | Sber | Skoltech

Scientific literature exhibits high heterogeneity, and manual meta-analyses are inefficient and error-prone. Method: This paper proposes an intelligent agent pipeline tailored for systematic reviews. It introduces a novel, expert-knowledge-guided, multi-stage collaborative agent architecture that integrates structured human–agent dialogue, cross-modal information extraction (from text, tables, and figures), and standardized semantic mapping—enabling one-time domain knowledge injection and end-to-end knowledge-driven processing. Contribution/Results: We present the first reusable, end-to-end evidence structuring framework that automatically transforms unstructured scientific papers into unified, machine-readable, standardized evidence tables. Evaluated on a meta-analysis task for NMC811 lithium-ion battery cathode materials, our pipeline reduces analysis time from months to minutes while ensuring high reproducibility. This significantly advances the automation, scalability, and reliability of large-scale literature synthesis.

Extract specific information from large scientific literature corpusReduce meta-analysis preparation time from months to minutesTransform heterogeneous article content into unified machine-readable representation

IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedback

Oct 05, 2024
KP
Kevin Pu
🏛️ University of Toronto | University of Washington | Allen Institute for AI

Existing research ideation tools emphasize breadth-oriented idea generation but lack support for iterative refinement, elaboration, and evaluation—hindering literature-grounded, deep-reading–driven conceptual evolution. Method: We propose the first literature-driven interactive research ideation system, integrating a composable “idea element” canvas model with a multi-dimensional (problem/solution/evaluation/contribution) co-evolution mechanism. Our approach innovatively incorporates LLM-powered literature-aware feedback generation, graph-structured idea modeling, and interactive multi-path variant exploration. Contribution/Results: Experiments demonstrate a 42% increase in user-generated idea output and significantly enhanced detail elaboration. Seven researchers successfully applied the system across the full ideation pipeline—from initial topic conception to paper outline revision—validating its efficacy in supporting deep, iterative, literature-informed research design.

Bridges gap between broad idea generation and deep refinementEnables evolving and composing idea facets for research developmentSupports iterative refinement of research ideas with literature feedback

Latest Papers

What's happening recently
View more

This work addresses the challenge of quantifying the academic impact of commercial engineering software such as Ansys Granta, which is hindered by inconsistent citation practices and rapidly growing publication volumes. We propose the first reproducible, semi-automated framework that integrates DOI and citation parsing, expert annotation, and a relational database (Ansys Granta MI Enterprise) to transform heterogeneous usage evidence into a structured knowledge base. As of September 2025, the framework has compiled a multi-source literature repository comprising over 1,100 manually verified records, enabling rapid retrieval, systematic review reproduction, and technology landscape scanning. The resulting knowledge base reveals dominant application domains, key contributing institutions, and integration patterns within CAD/CAE/FEM environments, thereby facilitating systematic tracking and analysis of the long-term technical influence of commercial engineering software.

Ansys Grantabibliometric analysismaterials informatics

This study addresses the scalability limitations of quantitative evidence synthesis, which remains heavily reliant on manual effort and thus impedes timely access to reliable knowledge in research, medicine, and policy. The authors propose the first end-to-end multi-agent system capable of autonomously conducting full meta-analyses from natural language research questions. The system performs literature retrieval, screening, data extraction, effect size computation, and random-effects meta-analysis, while also supporting heterogeneity assessment and risk-of-bias evaluation. It generates complete, PRISMA-compliant meta-analysis reports without human intervention. Validated on over 28 studies, the system extracted more than 20 quantitative findings and produced pooled effect estimates highly concordant with those derived manually by experts, substantially enhancing the scalability, transparency, and reliability of evidence synthesis.

automationevidence synthesismeta-analysis

This study addresses the frequent under-identification and inadequate interpretation of outliers, non-replicable findings, and highly influential studies in meta-analyses, which often compromise the robustness of conclusions. It clarifies conceptual distinctions among these three types of problematic studies and proposes a systematic diagnostic framework that integrates robust statistical methods, graphical diagnostic tools, and advanced modeling techniques accounting for sampling variance dependencies. This approach enables more accurate detection of anomalous studies while leveraging visualization to facilitate interpretation of their potential sources. By synthesizing recent methodological advances, the work offers meta-analysts practical diagnostic strategies and cautious interpretive guidance, substantially enhancing the reliability and transparency of meta-analytic results.

evidence synthesisinfluential studiesmeta-analysis

Existing meta-analysis tools often relegate researchers to mere search operators, fragmenting their cognitive coherence and diminishing their epistemic agency. To address this limitation, this work proposes Research IDE—an integrated development environment grounded in the “research-as-code” paradigm. By deeply integrating multi-agent systems into the scholarly writing workflow, Research IDE introduces a novel “hypothesis breakpoint” mechanism that enables researchers to validate hypotheses in real time, invoke prior knowledge, and maintain a closed-loop reasoning process during manuscript composition. Preliminary expert evaluations indicate that this approach effectively preserves users’ cognitive primacy, fosters the emergence of novel insights, and has garnered strong endorsement from domain specialists.

abductive reasoningintellectual ownershipmeta-analysis

This study addresses the persistent gap between systematic literature reviews (SLRs) in software engineering and their practical uptake in industry, often referred to as the evidence-to-practice translation gap. To bridge this divide, the work introduces the Evidence to Decision (EtD) framework—originally developed in health sciences—into software engineering for the first time. By convening expert panels to conduct structured evaluations of SLR evidence against multidimensional criteria, the approach generates practitioner-oriented evidence briefs and actionable recommendations. This methodology strengthens the mechanism for translating research findings into real-world decisions, offering the first application of EtD in software engineering, identifying key dimensions essential for generating trustworthy recommendations, and highlighting major challenges that must be addressed for broader adoption of the framework.

Evidence to DecisionEvidence-Based Software EngineeringResearch-Practice Gap

Hot Scholars

MT

Mike Thelwall

School of Information, Journalism and Communication, The University of Sheffield
scientometricsaltmetricssentiment analysissocial media
MK

Marcos Kalinowski

Professor, Pontifical Catholic University of Rio de Janeiro (PUC-Rio)
Empirical Software EngineeringAI EngineeringAI4SEHuman Aspects in Software Engineering
CZ

Chengzhi Zhang

Nanjing University of Science and Technology
Text MiningNatural Language ProcessingScience of Science
RD

Ronnie de Souza Santos

Assistant Professor, University of Calgary
Human Aspects of Software EngineeringSoftware TestingSoftware FairnessSoftware Development
RH

Rashina Hoda

Professor of Software Engineering, Faculty of Information Technology, Monash University, Australia
Agile Software DevelopmentAgile Project ManagementGrounded TheoryHuman Aspects