Skip to contentScholarGate
LibraryBookshelfDeskReview StudioAssistant
Sign in
On this page
IntuitionHow it worksWhen to use itStrengths & limitationsCommon pitfallsApplicationsFrequently asked🔒 Read the full methodSourcesRelated methods
Cite this pageSpotted an issue on this page? Report or suggest a fix →
Home›Evidence Synthesis›Umbrella Review
Process / pipelineEvidence Synthesis Integration

Umbrella Review

Umbrella Review (Systematic Review of Systematic Reviews) · Also known as: Overview of Reviews, Meta-Review, Review of Reviews

An umbrella review is a systematic synthesis of multiple systematic reviews addressing overlapping or related research questions, typically on the same topic or intervention. Also called a 'review of reviews' or 'overview of reviews,' umbrella reviews consolidate evidence when two or more high-quality systematic reviews exist on the same clinical question. Grant and Booth (2009) formally categorized this methodology; Shea et al. (2017) developed AMSTAR-2, the critical appraisal tool for assessing the quality of included reviews. Umbrella reviews are essential when numerous systematic reviews produce conflicting conclusions, when rapid synthesis of evidence is needed for policy or clinical guidance, or when evidence has accumulated faster than any single systematic review can capture.

ScholarGate
  1. Process / pipeline
  2. v1
  3. 3 Sources
  4. PUBLISHED
Cite this page →
Tools & resources
Download slides
Learn & explore

Read the full method

Members only

Sign in with a free account to read this section.

Sign in

Method map

The neighbourhood of related methods — select a node to explore.

Umbrella Review
Rapid Review MethodologyScoping Review Methodolo…Integrative ReviewMapping ReviewNarrative ReviewNetwork-based Meta-analy…PRISMA-based reviewPRISMA-compliant Scoping…PRISMA-compliant Umbrell…Protocol-based Systemati…

+4 more

When to use it

Conduct an umbrella review when (1) two or more systematic reviews address the same or overlapping research question, (2) conclusions among reviews conflict and clinicians/policymakers need clarification, (3) a rapid synthesis is urgently needed for clinical guidance or policy and existing reviews can be efficiently integrated, (4) evidence has accumulated since major reviews were published and you want to assess whether new evidence changes conclusions, or (5) stakeholders need a comprehensive overview of the evidence base across multiple related interventions (e.g., comparing multiple surgical approaches to the same condition). Umbrella reviews are particularly useful in rapidly evolving fields (oncology, mental health, digital health) where many systematic reviews accumulate.

Strengths & limitations

Strengths
  • Efficiently synthesizes evidence from multiple high-quality systematic reviews, saving time and resources compared to conducting a new comprehensive systematic review.
  • Identifies and resolves disagreement among systematic reviews, clarifying evidence for clinicians and policymakers.
  • Incorporates the highest level of evidence (reviews of reviews) and leverages existing methodological rigor already invested in component reviews.
  • Can produce evidence faster than updating individual reviews, enabling timely guidance for rapidly evolving topics.
  • Assesses review quality explicitly with AMSTAR-2, distinguishing high-quality reviews from lower-quality ones and informing how much weight each deserves.
Limitations
  • Quality of the umbrella review is constrained by quality of included reviews. If component reviews are biased or methodologically weak, synthesis results cannot exceed that ceiling.
  • May introduce double-counting bias if umbrella review combines findings from multiple reviews that partially overlap in their included primary studies.
  • Umbrella review findings may become outdated quickly if new primary studies are published between the latest systematic review and the umbrella synthesis.
  • If included systematic reviews disagree substantially in population, intervention definition, or outcome measurement, heterogeneity limits meaningful synthesis.

Frequently asked

What is the difference between an umbrella review and an updated systematic review?

An updated systematic review re-conducts the original search (in updated databases) and incorporates new primary studies. An umbrella review synthesizes existing systematic reviews without re-searching for primary studies. If an old systematic review exists and many new RCTs have published, updating the review may be preferable. If multiple different systematic reviews exist (with different populations or outcomes), an umbrella review synthesis is appropriate.

How do I handle overlapping studies when multiple reviews include some of the same primary trials?

This is double-counting bias. If Reviews A and B both included Study X, you cannot simply add their effect estimates together. Options: (1) Use qualitative synthesis and focus on conclusions rather than pooling numbers; (2) Adjust for overlap (e.g., calculate weighted average accounting for shared studies); (3) Perform sensitivity analysis comparing results with and without overlap adjustment. Document overlap explicitly in results.

What quality threshold should I use for including reviews?

Include all systematic reviews meeting your definition of a systematic review (explicit search, selection criteria, quality assessment), regardless of AMSTAR-2 rating. However, weight high-quality reviews (AMSTAR-2 High or Moderate) more heavily in conclusions than critically low-quality reviews. Exclude only true narrative reviews or scoping reviews, which lack the rigor of systematic reviews.

How do I decide between quantitative and qualitative synthesis in an umbrella review?

If included reviews are homogeneous in population, intervention, comparator, and outcome measurement, quantitative synthesis (pooling effect estimates) may be possible. However, this is risky due to double-counting. If reviews differ meaningfully in scope or conclude differently, use narrative synthesis, creating a summary of findings table that displays each review's quality, population, intervention, outcomes, and main conclusions. Narrative synthesis is safer and often more transparent.

Sources

  1. Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91–108. DOI: 10.1111/j.1471-1842.2009.00848.x ↗
  2. Moher, D., Shamseer, L., Clarke, M., et al. (2015). Preferred Reporting Items for Systematic Review and Meta-analysis Protocols (PRISMA-P) 2015 statement. Systematic Reviews, 4, 1. DOI: 10.1186/2046-4053-4-1 ↗
  3. Shea, B. J., Reeves, B. C., Wells, G., et al. (2017). AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ, 358, j4008. DOI: 10.1136/bmj.j4008 ↗

How to cite this page

ScholarGate. (2026, June 4). Umbrella Review (Systematic Review of Systematic Reviews). ScholarGate. https://scholargate.app/en/evidence-synthesis/umbrella-review

Related methods

Rapid Review MethodologyScoping Review Methodology

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

  • Rapid Review MethodologyEvidence Synthesis↔ compare
  • Scoping Review MethodologyEvidence Synthesis↔ compare
Compare side by side →

Referenced by

Integrative ReviewMapping ReviewNarrative ReviewNetwork-based Meta-analysisPRISMA-based reviewPRISMA-compliant Scoping reviewPRISMA-compliant Umbrella ReviewProtocol-based Systematic literature reviewProtocol-based Umbrella reviewRapid ReviewScoping ReviewSystematic Literature Review

Similar methods

PRISMA-compliant Umbrella ReviewProtocol-based Umbrella reviewSystematic ReviewRapid Review MethodologyRapid ReviewMapping ReviewMeta-analytic Randomized Clinical TrialMeta-Analysis

Related reference concepts

Systematic Review and Meta-AnalysisSystematic Review and Evidence SynthesisEvidence SynthesisEvidence SynthesisSystematic ReviewSystematic Review and Meta-Analysis

Spotted an issue on this page? Report or suggest a fix →

ScholarGate — Umbrella Review (Umbrella Review (Systematic Review of Systematic Reviews)). Retrieved 2026-07-21 from https://scholargate.app/en/evidence-synthesis/umbrella-review · Dataset: https://doi.org/10.5281/zenodo.20539026
Quick facts
Originator
Grant & Booth (2009), Refined by AMSTAR-2 (Shea et al., 2017)
Subfamily
Evidence Synthesis Integration
Year
2009
Type
Framework
Related methods
Rapid Review MethodologyScoping Review Methodology
ScholarGate

A content-first reference library for research methods — what each one is, how it works, and where it comes from.

Open data (CC-BY)

Explore

  • Library
  • Search the library…
  • Browse by field
  • Fields
  • Journey
  • Compare
  • Which method?

Reference

  • Subjects
  • Atlas
  • Glossary
  • Methodology
  • Philosophy

Your tools

  • Bookshelf
  • Desk
  • Chat

Company

  • About
  • Pricing
  • Contact
  • Suggest a method

Entries are compiled from published sources for reference. Verifying the accuracy and suitability of any information for your own use remains your responsibility.

© 2026 ScholarGate · A research-method reference library
  • Privacy
  • Cookies
  • Terms
  • Delete account