Evidence Synthesis and Critical Appraisal

Evidence synthesis is the process of systematically locating, selecting, and combining the results of primary studies into a coherent summary, most rigorously through systematic reviews and, where appropriate, meta-analysis. Critical appraisal is the structured assessment of a study's or review's validity, results, and applicability. Together they let physiotherapists judge how trustworthy the available evidence is and how far it applies to their patients.

Definition

Evidence synthesis is the systematic identification, appraisal, and combination of relevant studies into an overall summary of what is known, and critical appraisal is the explicit, structured evaluation of the validity, magnitude, precision, and applicability of research findings.

Scope

The entry covers systematic reviews and meta-analysis as methods of synthesis, reporting standards such as PRISMA, tools for appraising study quality and risk of bias, and frameworks such as GRADE for rating the certainty of evidence. It is a methodological topic about how evidence is summarized and judged, not a source of clinical recommendations or treatment advice.

Core questions

• How are systematic reviews and meta-analyses conducted and reported?
• How is the risk of bias in a study or review assessed?
• How is the overall certainty of a body of evidence rated?
• How does a clinician judge whether evidence applies to a particular patient?

Key concepts

• Systematic review
• Meta-analysis and pooled effect estimates
• Risk of bias and study quality
• PRISMA reporting standards
• PEDro scale for rating trials
• GRADE certainty of evidence
• Heterogeneity
• Publication bias
• Applicability and external validity

Key theories

Systematic review and meta-analysis

A method that uses a pre-specified protocol, comprehensive search, explicit selection and risk-of-bias assessment, and — where studies are sufficiently similar — statistical pooling to produce a transparent, reproducible synthesis of evidence.

GRADE certainty-of-evidence framework

A structured approach that rates the certainty of a body of evidence for each outcome (high to very low) by considering risk of bias, inconsistency, indirectness, imprecision, and publication bias, separating certainty from the strength of any recommendation.

Mechanisms

A systematic review begins from a focused question and protocol, searches comprehensively, screens studies against explicit criteria, and assesses each for risk of bias; the PRISMA statement specifies what should be reported at each step so the process is transparent and reproducible. When included studies are similar enough, meta-analysis pools their effect estimates into a weighted summary, with statistical assessment of heterogeneity. Critical appraisal of individual studies uses structured tools — in physiotherapy the PEDro scale rates the methodological quality of randomized trials — and the GRADE framework then rates the certainty of the combined evidence for each outcome. Applicability is judged separately: even valid evidence must fit the patient's characteristics and setting to inform a decision.

Clinical relevance

Synthesis and appraisal let physiotherapists weigh competing claims and avoid being misled by single studies or biased reports, supporting the research-evidence element of evidence-based practice. This entry describes how evidence is summarized and judged; it is educational and does not itself recommend or rate any specific intervention for patients.

Evidence & guidelines

Reporting of systematic reviews is governed by the PRISMA statement, originally published in 2009 and updated as PRISMA 2020 (Page and colleagues), while the certainty of evidence is widely rated with GRADE (Guyatt and colleagues, 2008). Within physiotherapy the PEDro scale (Maher and colleagues, 2003) is a standard tool for appraising the quality of randomized controlled trials, and the PEDro database indexes appraised trials and reviews.

History

Meta-analysis and the systematic review developed across the late twentieth century, institutionalized by the Cochrane Collaboration from 1993. Reporting standards followed: QUOROM and then PRISMA in 2009, updated in 2020. The GRADE working group formalized certainty rating in the 2000s, and physiotherapy contributed domain-specific tools such as the PEDro scale and database to make appraisal of rehabilitation trials systematic.

Debates

When should studies be pooled in a meta-analysis?

Combining heterogeneous studies can produce a precise but misleading summary; deciding when clinical and statistical heterogeneity preclude pooling, and how to handle it, remains a central methodological judgement.

How should certainty of evidence be distinguished from strength of recommendation?

GRADE deliberately separates how certain the evidence is from how strong a recommendation should be, because values, preferences, and trade-offs also bear on recommendations; applying this distinction consistently is an ongoing challenge.

Key figures

• David Moher
• Matthew Page
• Gordon Guyatt
• Christopher Maher
• David Sackett

Seminal works

• moher-2009
• page-2021
• guyatt-2008-grade

Frequently asked questions

What is the difference between a systematic review and a meta-analysis?

A systematic review uses explicit, reproducible methods to find, appraise, and summarize studies; a meta-analysis is the optional statistical step within some reviews that pools the studies' results into a single weighted estimate when they are similar enough.

Why is critical appraisal necessary if a study is published?

Publication does not guarantee validity; appraisal assesses the risk of bias, the precision and size of effects, and whether the findings apply to a given patient, so that conclusions are weighted by their trustworthiness.