What is a Systematic Review?
What is a Systematic Review?
A systematic review is a literature review that gathers all of the available evidence matching pre-specified eligibility criteria to answer a specific research question. It uses explicit, systematic methods, documented in a protocol, to minimize bias, provide reliable findings, and inform decision-making. ¹
There are many types of literature reviews.
Before beginning a systematic review, consider whether it is the best type of review for your question, goals, and resources. The table below compares a few different types of reviews to help you decide which is best for you.
| Systematic Review | Scoping Review | Systematized Review |
|---|---|---|
| Conducted for Publication | Conducted for Publication | Conducted for Assignment, Thesis, or (Possibly) Publication |
| Protocol Required | Protocol Required | No Protocol Required |
| Focused Research Question | Broad Research Question | Either |
| Focused Inclusion & Exclusion Criteria | Broad Inclusion & Exclusion Criteria | Either |
| Requires Large Team | Requires Small Team | Usually 1-2 People |
- Scoping Review GuideFor more information about scoping reviews, refer to the UNC HSL Scoping Review Guide.
A simplified process map
- UNC HSL's Simplified, Step-by-Step Process MapA PDF file of the HSL's Systematic Review Process Map.
- Text-Only: UNC HSL's Systematic Reviews - A Simplified, Step-by-Step ProcessA text-only PDF file of HSL's Systematic Review Process Map.
Systematic Reviews: a Simplified, Step-by-Step Process © 2021 by Emily P. Jones & Michelle Cawley is licensed under CC BY-NC 4.0.
How can the library help?
The average systematic review takes 1,168 hours to complete.¹
A librarian can help you speed up the process.
Systematic reviews follow established guidelines and best practices to produce high-quality research. Librarian involvement in systematic reviews is based on two levels. In Tier 1, your research team can consult with the librarian as needed. The librarian will answer questions and give you recommendations for tools to use. In Tier 2, the librarian will be an active member of your research team and co-author on your review. Roles and expectations of librarians vary based on the level of involvement desired. Examples of these differences are outlined in the table below.
| Tasks | Tier 1: Consultative | Tier 2: Research Partner / Co-author |
|---|---|---|
| Topic Development | ||
| Guidance on process and steps | Yes | Yes |
| Background searching for past and upcoming reviews | Yes | Yes |
| Development of Eligibility Criteria | ||
| Development and/or refinement of review topic | Yes | Yes |
| Assistance with refinement of PICO (population, intervention(s), comparator(s), and key questions | Yes | Yes |
| Guidance on study types to include | Yes | Yes |
| Protocol Creation and Registration | ||
| Guidance on protocol registration | Yes | Yes |
| Searching | ||
| Identification of databases for searches | Yes | Yes |
| Instruction in search techniques and methods | Yes | Yes |
| Training in citation management software use for managing and sharing results | Yes | Yes |
| Development and execution of searches | No | Yes |
| Downloading search results to citation management software and removing duplicates | No | Yes |
| Documentation of search strategies | No | Yes |
| Management of search results | No | Yes |
| Study Selection and Extraction | ||
| Guidance on methods | Yes | Yes |
| Guidance on data extraction, and management techniques and software | Yes | Yes |
| Writing and Publishing | ||
| Suggestions of journals to target for publication | Yes | Yes |
| Drafting of literature search description in "Methods" section | No | Yes |
| Creation of PRISMA diagram | No | Yes |
| Drafting of literature search appendix | No | Yes |
| Review other manuscript sections and final draft | No | Yes |
| Librarian contributions warrant co-authorship | No | Yes |
Publications by HSL Librarians
The following are systematic and scoping reviews co-authored by HSL librarians.
Only the most recent 15 results are listed. Click the website link at the bottom of the list to see all reviews co-authored by HSL librarians in PubMed
Loading ...
Systematic reviews in non-health disciplines
Researchers conduct systematic reviews in a variety of disciplines. If your focus is on a topic outside of the health sciences, you may want to also consult the resources below to learn how systematic reviews may vary in your field. You can also contact a librarian for your discipline with questions.
Education
- EPPI-Centre methods for conducting systematic reviewsThe EPPI-Centre develops methods and tools for conducting systematic reviews, including reviews for education, public and social policy.
Systematic Reviews in Educational Research by
In this open access edited volume, international researchers of the field describe and discuss the systematic review method in its application to research in education. Alongside fundamental methodical considerations, reflections and practice examples are included and provide an introduction and overview on systematic reviews in education research.
ISBN: 9783658276010Publication Date: 2019-12-02
Environmental Topics
- Collaboration for Environmental Evidence (CEE)CEE seeks to promote and deliver evidence syntheses on issues of greatest concern to environmental policy and practice as a public service
Social Sciences
Systematic Reviews in the Social Sciences by
(The links in this book tend to be out of date, but the explanations of the systematic review process are clear and well-laid out). Written by two highly-respected social scientists, provides an overview of systematic literature review methods: outlines the rationale and methods of systematic reviews; gives worked examples from social science and other fields; Takes the reader through the process stage by stage; Including detailed sections on assessing the quality of both quantitative, and qualitative research; searching for evidence in the social sciences; meta-analytic and other methods of evidence synthesis; publication bias; heterogeneity; and approaches to dissemination.
ISBN: 9781405121101Publication Date: 2005-12-16
Finding and Evaluating Evidence by
Evidence-based practice (EBP) promises to have a profound impact on social work practice, education, and scholarship, but adopting EBP depends on the availability and accessibility of evidence and on strategies to synthesize this information. Systematic reviews provide a comprehensive,unbiased method for retrieving and synthesizing relevant research. This pocket guide is a concise introduction that describes the steps required to complete a systematic review and the criteria that can be used to assess the quality of existing reviews.The authors provide straightforward information on how to define a search question that captures the problem's parameters, develop a search strategy that is transparent and comprehensive, assess the quality and credibility of existing research, and summarize the available research to support EBP insocial work. Providing coverage for both quantitative and qualitative synthesis methods, examples illustrate the steps and decisions associated with each approach to research synthesis. Key points and suggested readings and websites provide avenues for further study. This pocket guide is anexcellent introduction to EBP and systematic reviews that will be valued by social work students, practitioners, and scholars.
ISBN: 9780195337365Publication Date: 2011-09-22- Systematic reviews and meta-analysis by This pocket guide to Systematic Reviews and Meta-Analysis illuminates precisely that practical groundwork.In clear, step-by-step terms, the authors explain how to format topics, locate and screen studies, extract and assess data, pool effect sizes, determine bias, and interpret the results, showing readers how to combine reviewing and meta-analysis correctly and effectively.ISBN: 978019532654Publication Date: 2008
- Siddaway AP, Wood AM, Hedges LV. How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annu Rev Psychol. 2019 Jan 4;70:747-770. doi: 10.1146/annurev-psych-010418-102803.A resource for psychology systematic reviews, which also covers qualitative meta-syntheses or meta-ethnographies
Social Work
Systematic Reviews and Meta-Analysis by
When used in tandem, systematic reviews and meta-analysis-- two distinct but highly compatible approaches to research synthesis-- form a powerful, scientific approach to analyzing previous studies. But to see their full potential, a social work researcher must be versed in the foundationalprocesses underlying them. This pocket guide to Systematic Reviews and Meta-Analysis illuminates precisely that practical groundwork.In clear, step-by-step terms, the authors explain how to format topics, locate and screen studies, extract and assess data, pool effect sizes, determine bias, and interpret the results, showing readers how to combine reviewing and meta-analysis correctly and effectively. Each chapter containsvivid social work examples and concludes with a concise summary and notes on further reading, while the book's glossary and handy checklists and sample search and data extraction forms maximize the boo'ks usefulness.Highlighting the concepts necessary to understand, critique, and conduct research synthesis, this brief and highly readable introduction is a terrific resource for students and researchers alike.
Call Number: H62 .L497 2008 (Davis 5th floor)ISBN: 9780195326543Publication Date: 2008-02-13- Finding and Evaluating Evidence by
Evidence-based practice (EBP) promises to have a profound impact on social work practice, education, and scholarship, but adopting EBP depends on the availability and accessibility of evidence and on strategies to synthesize this information. Systematic reviews provide a comprehensive,unbiased method for retrieving and synthesizing relevant research. This pocket guide is a concise introduction that describes the steps required to complete a systematic review and the criteria that can be used to assess the quality of existing reviews.The authors provide straightforward information on how to define a search question that captures the problem's parameters, develop a search strategy that is transparent and comprehensive, assess the quality and credibility of existing research, and summarize the available research to support EBP insocial work. Providing coverage for both quantitative and qualitative synthesis methods, examples illustrate the steps and decisions associated with each approach to research synthesis. Key points and suggested readings and websites provide avenues for further study. This pocket guide is anexcellent introduction to EBP and systematic reviews that will be valued by social work students, practitioners, and scholars.
ISBN: 9780195337365Publication Date: 2011-09-22
Software engineering
- Guidelines for Performing Systematic Literature Reviews in Software EngineeringThe objective of this report is to propose comprehensive guidelines for systematic literature reviews appropriate for software engineering researchers, including PhD students.
Evidence-Based Software Engineering and Systematic Reviews by
In the decade since the idea of adapting the evidence-based paradigm for software engineering was first proposed, it has become a major tool of empirical software engineering. Evidence-Based Software Engineering and Systematic Reviews provides a clear introduction to the use of an evidence-based model for software engineering research and practice. The book explains the roles of primary studies (experiments, surveys, case studies) as elements of an over-arching evidence model, rather than as disjointed elements in the empirical spectrum. Supplying readers with a clear understanding of empirical software engineering best practices, it provides up-to-date guidance on how to conduct secondary studies in software engineering--replacing the existing 2004 and 2007 technical reports. The book is divided into three parts. The first part discusses the nature of evidence and the evidence-based practices centered on a systematic review, both in general and as applying to software engineering. The second part examines the different elements that provide inputs to a systematic review (usually considered as forming a secondary study), especially the main forms of primary empirical study currently used in software engineering. The final part provides practical guidance on how to conduct systematic reviews (the guidelines), drawing together accumulated experiences to guide researchers and students in planning and conducting their own studies. The book includes an extensive glossary and an appendix that provides a catalogue of reviews that may be useful for practice and teaching.
Call Number: QA76.758 .K58 2016 (Science Annex)ISBN: 9781482228656Publication Date: 2015-11-05
Sport, Exercise, & Nutrition
Conducting Systematic Reviews in Sport, Exercise, and Physical Activity by
This book offers a conceptual and practical guide to the systematic review process and its application to sport, exercise, and physical activity research. It begins by describing what systematic reviews are and why they assist scientists and practitioners. Providing step-by-step instructions the author leads readers through the process, including generation of suitable review questions; development and implementation of search strategies; data extraction and analysis; theoretical interpretation; and result dissemination. Conducting Systematic Reviews in Sport, Exercise, and Physical Activity clarifies several common misunderstandings including the difference between qualitative systematic reviews and meta-analyses . Each chapter begins with a set of learning objectives focused on practical application, illustrated with examples from reviews published within the sport, exercise, and physical activity fields. Once a reader has completed all the learning activities along the way, they will have designed a systematic review and have written a protocol ready for registration. The book ends with a collection of advice from internationally regarded scientists with substantial experience in systematic reviews.
ISBN: 9783030122621Publication Date: 2019-09-11- Application of systematic review methodology to the field of nutrition byPublication Date: 2009
Resources for performing systematic reviews
- Systematic Reviews and Meta-Analysis — Open & Free (Open Learning Initiative)The course follows guidelines and standards developed by the Campbell Collaboration, based on empirical evidence about how to produce the most comprehensive and accurate reviews of research
An Introduction to Systematic Reviews by
Focused on actively using systematic review as method, this book provides clear, step-by-step advice on the logic and processes of systematic reviewing. Stressing the importance of precision and accuracy, this new edition carefully balances a need for insightful theory with real-world pragmatism; it introduces a wide range of cutting-edge approaches to research synthesis including text mining, living reviews and new ideas in mixed methods reviews such as qualitative comparative analysis. The book also includes: A new chapter on statistical synthesis Coverage of computer-assisted methods and relevant software Expanded sections on data extraction and management A guide to working with many different types of data including longitudinal and panel. Packed with examples from across the social sciences, this book helps students and researchers alike in turning systematic reviews into recommendations for policy and practice.
Call Number: H62 .I658 2017 (Davis 5th floor)ISBN: 9781473929425Publication Date: 2017-05-05
Doing a Systematic Review by
Written in a friendly, accessible style by an expert team of authors with years of experience in both conducting and supervising systematic reviews, this is the perfect guide to using systematic review methodology in a research project. It provides clear answers to all review-related questions, including: How do I formulate an appropriate review question? What's the best way to manage my review? How do I develop my search strategy? How do I get started with data extraction? How do I assess the quality of a study? How can I analyse and synthesize my data? How should I write up the discussion and conclusion sections of my dissertation or thesis?
Call Number: R853.S94 D65 2017 (Davis 8th floor)ISBN: 9781473967007Publication Date: 2017-11-23
Systematic Approaches to a Successful Literature Review by
Reviewing the literature is an essential part of every research project. This book takes you step-by-step through the process of approaching your literature review systematically, applying systematic principles to a wide range of literature review types. Through numerous examples, case studies and exercises, the book covers often neglected areas of literature review such as concept analysis, scoping and mapping. The book includes practical tools for supporting the various stages of the review process, including; - managing your literature review - searching the literature - assessing the quality of the literature - synthesising qualitative and/or quantitative data - writing up and presenting data Systematic Approaches to a Successful Literature Review is essential reading for any student or researcher looking to approach their literature review in a systematic way.
Call Number: Q180.55.M4 B66 2012 (Davis 8th floor)ISBN: 9780857021342Publication Date: 2012-01-24- Systematic Reviews byPublication Date: 2020
Systematic Reviews by
Any piece of primary research ought to be preceded by a systematic review. The key advantage of a systematic review over the traditional narrative review is its ability to identify all the available eveidence in a systematic and replicable manner. This book will describe a) the key steps to undertaking a systematic review and b) the process of undertaking a meta-analysis. The book will include step-by-step examples of how to design data extraction forms, search strategies and combine in a meta-analysis.
Call Number: H 62 T682s 2003 (HSL 3rd floor) H62 .T682 2003 (Davis 5th floor)ISBN: 9780826465801Publication Date: 2003-12-01
Doing Your Literature Review by
The literature review is a compulsory part of research and, increasingly, may form the whole of a student research project. This highly accessible book guides students through the production of either a traditional or a systematic literature review, clearly explaining the difference between the two types of review, the advantages and disadvantages of both, and the skills needed. It gives practical advice on reading and organising relevant literature and critically assessing the reviewed field. Contents include: using libraries and the internet note making presentation critical analysis referencing, plagiarism and copyright. This book will be relevant to students from any discipline. It includes contributions from two lecturers who have many years experience of teaching research methods and the supervision of postgraduate research dissertations and a librarian, each offering expert advice on either the creation and assessment of literature reviews or the process of searching for information. The book also highlights the increasing importance for many disciplines of the systematic review methodology and discusses some of the specific challenges which it brings. Jill K. Jesson has worked with multi-disciplinary research teams within the Aston School of Pharmacy, Aston Business School and with M-E-L Research, an independent public services research consultancy. She has now left Aston University and is working as a Consultant. Lydia Matheson is an Information Specialist working for Library & Information Services at Aston University. Fiona M. Lacey is an academic pharmacist, a member of the pharmacy practice teaching group in the School of Pharmacy, and Associate Dean in the School of Life and Health Sciences at Aston.
Call Number: H62 .J44 2011 (Davis 5th floor)ISBN: 9781848601536Publication Date: 2011-03-14
An Introduction to Systematic Reviews by
This timely, engaging book provides an overview of the nature, logic, diversity and process of undertaking systematic reviews as part of evidence informed decision making. A focused, accessible and technically up-to-date book, it covers the full breadth of approaches to reviews from statistical meta analysis to meta ethnography. It is ideal for anyone undertaking their own systematic review - providing all the necessary conceptual and technical background needed to make a good start on the process. The content is divided into five clear sections: * Approaches to reviewing * Getting started * Gathering and describing research * Appraising and synthesising data * Making use of reviews/models of research use. Easy to read and logically structured, this book is essential reading for anyone doing systematic reviews. David Gough is Professor of Evidence Informed Policy and Practice and Director of SSRU and its EPPI-Centre and Co-Editor of the journal Evidence & Policy. Sandy Oliver is Professor of Public Policy and Deputy Director of SSRU and its EPPI-Centre. James Thomas is Reader in Social Policy, Assistant Director of SSRU and Associate Direcctor of the EPPI-Centre.
Call Number: H62 .G68 2012 (Davis 5th floor)ISBN: 9781849201803Publication Date: 2012-04-04
Doing a Systematic Review by
If you are a Masters or a PhD student conducting a systematic review for your dissertation or thesis, then this is the book for you! Written by an expert team of authors with years of experience in conducting systematic reviews and supervising students doing systematic reviews, the book provides a roadmap to guide you through the process. The book addresses the following questions: - What′s the best way to manage my review? - How do I formulate an appropriate review question? - How do I develop my search strategy? - How do I get started on data extraction? - How do I assess the quality of the studies I′m using? - How can I analyse and synthesise my data? - How should I write up the discussion and conclusion sections of my dissertation or thesis? - Where should I publish my data? Throughout the book, the authors make extensive use of questions posed by real students when carrying out reviews to help you through some of the challenges you may face. Like a team of supervisors in your pocket, this book will provide you with the tips and tools for a successful dissertation.
Call Number: W 20.5 D657 2014 (HSL 3rd floor)ISBN: 9781446269688Publication Date: 2013-12-20
Updating reviews
- Updating systematic reviews byPublication Date: 2007