Skip to Main Content
Albert S. Cook Library

Planning For Your Expert Literature Review

Engage the Review Team

"The review team should be capable of defining the clinical question and performing the technical aspects of the review. It should be multidisciplinary, with experts in SR methodology, including risk of bias, study design, and data analysis; librarians or information specialists trained in searching bibliographic databases for SRs; and clinical content experts."
  • Institute of Medicine (US) Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Eden, J., Levit, L., Berg, A., & Morton, S. (Eds.). (2011). Finding What Works in Health Care: Standards for Systematic Reviews. National Academies Press (US). https://www.ncbi.nlm.nih.gov/books/NBK209515/

In the case that your review is not clinical in nature, there are other methods documents to support these types of publications. Talk to your librarian to find out more. Although some of the first systematic reviews were clinical, systematic reviews do not necessarily need to be focused on clinical topics.

Further Reading

  • Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017). Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. BMJ Open, 7(2), e012545. https://doi.org/10.1136/bmjopen-2016-012545

Formulate the Topic

"The research question should be precise so that the review team can structure the other components of the SR. To inform decision making, research questions should focus on the uncertainties that underlie disagreement in practice, and the outcomes and interventions that are of interest to patients and clinicians."
  • Institute of Medicine (US) Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Eden, J., Levit, L., Berg, A., & Morton, S. (Eds.). (2011). Finding What Works in Health Care: Standards for Systematic Reviews. National Academies Press (US). https://www.ncbi.nlm.nih.gov/books/NBK209515/

For more help in selecting a viable topic, see the Question Development Frameworks listed on the Searching for Evidence in the Health Professions guide.

Develop the Protocol

"Systematic reviews should build on a protocol that describes the rationale, hypothesis, and planned methods of the review."
  • Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & PRISMA-P Group (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews, 4(1), 1. https://doi.org/10.1186/2046-4053-4-1

"A protocol should be made publicly available at the start of an SR in order to prevent the effects of author bias, allow feedback at an early stage in the SR, and tell readers of the review about protocol changes that occur as the SR develops."
  • Institute of Medicine (US) Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Eden, J., Levit, L., Berg, A., & Morton, S. (Eds.). (2011). Finding What Works in Health Care: Standards for Systematic Reviews. National Academies Press (US). https://www.ncbi.nlm.nih.gov/books/NBK209515/

Search for the Evidence

"The overarching objective of the SR search for evidence is to identify all the studies (and all the relevant data from the studies) that may pertain to the research question and analytic framework. The task is a challenging one."
  • Institute of Medicine (US) Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Eden, J., Levit, L., Berg, A., & Morton, S. (Eds.). (2011). Finding What Works in Health Care: Standards for Systematic Reviews. National Academies Press (US). https://www.ncbi.nlm.nih.gov/books/NBK209515/

A librarian can help you formulate an effective and documented search strategy for multiple databases.

Further Reading

  • Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., & PRISMA-S Group (2021). PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews. Systematic Reviews, 10(1), 39. https://doi.org/10.1186/s13643-020-01542-z
  • Rethlefsen, M. L., Farrell, A. M., Osterhaus Trzasko, L. C., & Brigham, T. J. (2015). Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews. Journal of Clinical Epidemiology, 68(6), 617–626. https://doi.org/10.1016/j.jclinepi.2014.11.025

Select the Evidence

"Experts agree that using two screeners can reduce error and subjectivity."
  • Institute of Medicine (US) Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Eden, J., Levit, L., Berg, A., & Morton, S. (Eds.). (2011). Finding What Works in Health Care: Standards for Systematic Reviews. National Academies Press (US). https://www.ncbi.nlm.nih.gov/books/NBK209515/

The PRISMA Flow Diagram details a two-step screening process:

  1. Title/abstract screening
  2. Full-text screening

Evaluate the Evidence

"There is good empirical evidence that particular features of the design, conduct and analysis of randomized trials lead to bias on average, and that some results of randomized trials are suppressed from dissemination because of their nature."

Types of bias can include:

  • publication bias
  • time-lag bias
  • language bias
  • citation bias
  • duplicate publication bias
  • location bias
  • selective or non-reporting bias
  • Higgins J.P.T., Thomas J., Chandler J., Cumpston M., Li T., Page M.J., Welch V.A. (Eds.). (2020 update). Cochrane Handbook for Systematic Reviews of Interventions version 6.1 (updated September 2020). Cochrane. Available from https://training.cochrane.org/handbook/current

Analyze and Interpret the Evidence

"The purpose of standards for evidence synthesis and assessment—as in other SR methods—is to set performance expectations and to promote accountability for meeting those expectations without stifling innovation in methods. Thus, the emphasis is not on specifying preferred technical methods, but rather the building blocks that help ensure objectivity, transparency, and scientific rigor."
  • Institute of Medicine (US) Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Eden, J., Levit, L., Berg, A., & Morton, S. (Eds.). (2011). Finding What Works in Health Care: Standards for Systematic Reviews. National Academies Press (US). https://www.ncbi.nlm.nih.gov/books/NBK209515/

Report the Results

The PRISMA Statement

PRISMA stands for Preferred Reporting Items for Systematic Reviews and Meta-Analyses. PRISMA has several extensions, including extensions for protocols, individual patient data, network meta-analyses, and more.