Umbrella Review
Umbrella Review (Systematic Review of Systematic Reviews) · Also known as: Overview of Reviews, Meta-Review, Review of Reviews
An umbrella review is a systematic synthesis of multiple systematic reviews addressing overlapping or related research questions, typically on the same topic or intervention. Also called a 'review of reviews' or 'overview of reviews,' umbrella reviews consolidate evidence when two or more high-quality systematic reviews exist on the same clinical question. Grant and Booth (2009) formally categorized this methodology; Shea et al. (2017) developed AMSTAR-2, the critical appraisal tool for assessing the quality of included reviews. Umbrella reviews are essential when numerous systematic reviews produce conflicting conclusions, when rapid synthesis of evidence is needed for policy or clinical guidance, or when evidence has accumulated faster than any single systematic review can capture.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
+4 more
When to use it
Conduct an umbrella review when (1) two or more systematic reviews address the same or overlapping research question, (2) conclusions among reviews conflict and clinicians/policymakers need clarification, (3) a rapid synthesis is urgently needed for clinical guidance or policy and existing reviews can be efficiently integrated, (4) evidence has accumulated since major reviews were published and you want to assess whether new evidence changes conclusions, or (5) stakeholders need a comprehensive overview of the evidence base across multiple related interventions (e.g., comparing multiple surgical approaches to the same condition). Umbrella reviews are particularly useful in rapidly evolving fields (oncology, mental health, digital health) where many systematic reviews accumulate.
Strengths & limitations
- Efficiently synthesizes evidence from multiple high-quality systematic reviews, saving time and resources compared to conducting a new comprehensive systematic review.
- Identifies and resolves disagreement among systematic reviews, clarifying evidence for clinicians and policymakers.
- Incorporates the highest level of evidence (reviews of reviews) and leverages existing methodological rigor already invested in component reviews.
- Can produce evidence faster than updating individual reviews, enabling timely guidance for rapidly evolving topics.
- Assesses review quality explicitly with AMSTAR-2, distinguishing high-quality reviews from lower-quality ones and informing how much weight each deserves.
- Quality of the umbrella review is constrained by quality of included reviews. If component reviews are biased or methodologically weak, synthesis results cannot exceed that ceiling.
- May introduce double-counting bias if umbrella review combines findings from multiple reviews that partially overlap in their included primary studies.
- Umbrella review findings may become outdated quickly if new primary studies are published between the latest systematic review and the umbrella synthesis.
- If included systematic reviews disagree substantially in population, intervention definition, or outcome measurement, heterogeneity limits meaningful synthesis.
Frequently asked
What is the difference between an umbrella review and an updated systematic review?
An updated systematic review re-conducts the original search (in updated databases) and incorporates new primary studies. An umbrella review synthesizes existing systematic reviews without re-searching for primary studies. If an old systematic review exists and many new RCTs have published, updating the review may be preferable. If multiple different systematic reviews exist (with different populations or outcomes), an umbrella review synthesis is appropriate.
How do I handle overlapping studies when multiple reviews include some of the same primary trials?
This is double-counting bias. If Reviews A and B both included Study X, you cannot simply add their effect estimates together. Options: (1) Use qualitative synthesis and focus on conclusions rather than pooling numbers; (2) Adjust for overlap (e.g., calculate weighted average accounting for shared studies); (3) Perform sensitivity analysis comparing results with and without overlap adjustment. Document overlap explicitly in results.
What quality threshold should I use for including reviews?
Include all systematic reviews meeting your definition of a systematic review (explicit search, selection criteria, quality assessment), regardless of AMSTAR-2 rating. However, weight high-quality reviews (AMSTAR-2 High or Moderate) more heavily in conclusions than critically low-quality reviews. Exclude only true narrative reviews or scoping reviews, which lack the rigor of systematic reviews.
How do I decide between quantitative and qualitative synthesis in an umbrella review?
If included reviews are homogeneous in population, intervention, comparator, and outcome measurement, quantitative synthesis (pooling effect estimates) may be possible. However, this is risky due to double-counting. If reviews differ meaningfully in scope or conclude differently, use narrative synthesis, creating a summary of findings table that displays each review's quality, population, intervention, outcomes, and main conclusions. Narrative synthesis is safer and often more transparent.
Sources
- Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91–108. DOI: 10.1111/j.1471-1842.2009.00848.x ↗
- Moher, D., Shamseer, L., Clarke, M., et al. (2015). Preferred Reporting Items for Systematic Review and Meta-analysis Protocols (PRISMA-P) 2015 statement. Systematic Reviews, 4, 1. DOI: 10.1186/2046-4053-4-1 ↗
- Shea, B. J., Reeves, B. C., Wells, G., et al. (2017). AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ, 358, j4008. DOI: 10.1136/bmj.j4008 ↗
How to cite this page
ScholarGate. (2026, June 4). Umbrella Review (Systematic Review of Systematic Reviews). ScholarGate. https://scholargate.app/en/evidence-synthesis/umbrella-review
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Rapid Review MethodologyEvidence Synthesis↔ compare
- Scoping Review MethodologyEvidence Synthesis↔ compare