Protocol-based Meta-analysis — Pre-registered Quantitative Evidence Synthesis
Protocol-based Meta-analysis · Also known as: pre-registered meta-analysis, prospective meta-analysis, registered meta-analysis, protocol-driven meta-analysis
A protocol-based meta-analysis is a meta-analysis conducted according to a detailed, pre-registered protocol that specifies all key methodological decisions — research questions, eligibility criteria, search strategy, outcome measures, and statistical methods — before data collection begins. Pre-registration, typically through PROSPERO or a comparable registry, distinguishes this approach from post-hoc or exploratory meta-analyses and substantially reduces the risk of selective reporting and outcome switching.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use a protocol-based meta-analysis when you intend to pool quantitative effect estimates across multiple primary studies and when methodological transparency and resistance to reporting bias are paramount — particularly in health sciences, clinical research, psychology, and policy-relevant fields. This approach is appropriate when a sufficient body of comparable primary studies exists (typically at least 5–10 with extractable effect sizes on the same outcome). It is the expected standard for systematic reviews submitted to high-impact journals or informing clinical guidelines. Do not use this approach when the research question is primarily qualitative or exploratory, when the body of literature is too heterogeneous in design or outcome measurement to justify statistical pooling, or when a narrative or scoping review is a better fit for the early mapping stage of a topic.
Strengths & limitations
- Pre-registration makes all analytical decisions publicly accountable before data are examined, eliminating outcome switching and reducing publication bias.
- The protocol provides a transparent audit trail that allows editors, peer reviewers, and readers to assess fidelity between the original plan and the final report.
- Adherence to established reporting standards (PRISMA-P for the protocol, PRISMA 2020 for the review) facilitates replication and cumulative science.
- Dual-reviewer screening and extraction with formal conflict resolution reduces idiosyncratic errors and increases reliability.
- Pre-specified sensitivity and subgroup analyses make the robustness of conclusions interpretable rather than post-hoc rationalizations.
- Writing and registering a rigorous protocol requires substantial methodological expertise and time investment before the review begins.
- The protocol locks in decisions that may prove impractical — if the anticipated body of literature differs from what is actually found, rigid adherence can produce an under-powered or poorly targeted synthesis.
- PROSPERO registration does not guarantee methodological quality; a poorly constructed protocol, once registered, is still a poor protocol.
- Protocol-based meta-analyses of the same question registered by different teams can diverge in findings if eligibility criteria or statistical models differ, complicating interpretation.
Frequently asked
Is PROSPERO registration mandatory?
PROSPERO registration is not legally mandatory, but it is increasingly required by high-impact journals and funding bodies in health-related fields. For meta-analyses outside health sciences, comparable registries (e.g., OSF Registries) serve a similar function. Even when not required, pre-registration substantially strengthens a paper's credibility and resistance to reviewer criticism about post-hoc analytical choices.
What should I do if my actual searches differ significantly from the protocol?
All deviations — including changes to search strings, databases, eligibility criteria, or statistical models — must be explicitly reported and justified in the final paper. A table comparing protocol commitments with actual actions is good practice. Deviations discovered after seeing the data are especially sensitive and should be flagged as exploratory rather than confirmatory analyses.
How is a protocol-based meta-analysis different from a standard meta-analysis?
A standard meta-analysis may or may not involve a pre-registered protocol; many are conducted opportunistically after a literature gap is identified. A protocol-based meta-analysis mandates that all key decisions are documented and publicly registered before data collection, providing an external check against analytical flexibility. The statistical methods are identical; the difference is entirely in the transparency and accountability of the process.
Can I amend the protocol after registration?
Yes — most registries including PROSPERO allow protocol amendments. The key requirement is that amendments are registered with a clear rationale and date, and that the final report distinguishes between analyses conducted as per the original protocol and those added or modified after registration.
How many studies do I need to justify a meta-analysis?
There is no absolute minimum, but pooling fewer than three to five studies rarely provides stable estimates and inflates the influence of any single study. The Cochrane Handbook recommends assessing whether pooling is appropriate based on clinical and methodological homogeneity, not solely on study count. The protocol should pre-specify a minimum threshold and the approach if that threshold is not met.
Sources
- Higgins, J. P. T., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M. J., & Welch, V. A. (Eds.). (2023). Cochrane Handbook for Systematic Reviews of Interventions (Version 6.4). Cochrane. link ↗
- Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews, 4(1), 1. DOI: 10.1186/2046-4053-4-1 ↗
How to cite this page
ScholarGate. (2026, June 3). Protocol-based Meta-analysis. ScholarGate. https://scholargate.app/en/scientometrics/protocol-based-meta-analysis
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Network Meta-AnalysisEvidence Synthesis↔ compare
- PRISMA-based reviewScientometrics↔ compare
- Scoping ReviewScientometrics↔ compare
- Systematic Literature ReviewScientometrics↔ compare