Multi-source Delphi Technique — Structured Expert Consensus Across Diverse Stakeholder Groups
Multi-source Delphi Technique · Also known as: Multi-stakeholder Delphi, Diverse-panel Delphi, Multi-group Delphi, MSDT
The Multi-source Delphi Technique is a structured, iterative consensus-building method that deliberately recruits expert panellists from multiple, distinct stakeholder groups or knowledge sources. By ensuring that no single professional community or institution dominates the panel, it reduces homogeneity bias and captures a broader range of perspectives than a conventional single-group Delphi. Panellists respond anonymously across successive rounds, receiving aggregated group feedback between rounds until consensus or a stable level of agreement is reached.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use the Multi-source Delphi when the research question requires expert consensus but the relevant expertise is distributed across distinct professional, disciplinary, or institutional communities — for example, developing clinical guidelines, educational frameworks, policy recommendations, or quality standards where a single-group panel would be incomplete or biased. It is especially appropriate when inter-group divergence is itself a finding of interest. Do not use it when a clear empirical answer is obtainable from existing data; when the stakeholder landscape is genuinely homogeneous (making the multi-source design redundant); or when time and budget preclude the logistics of multi-round, multi-group coordination. It is also unsuitable as a substitute for systematic review when adequate primary research already exists.
Strengths & limitations
- Reduces single-source and professional homogeneity bias by design, producing consensus that reflects a genuinely diverse knowledge base.
- Anonymity across rounds suppresses authority bias and encourages dissenting views that might be silenced in face-to-face settings.
- The iterative feedback loop gives panellists the opportunity to revise positions rationally rather than socially, improving the quality of the final consensus.
- Source-group breakdowns allow researchers to report not just where consensus was reached but also where inter-group divergence remained — a substantively important finding.
- Flexible format: applicable to guideline development, curriculum design, priority setting, and policy formulation across disciplines.
- Recruiting balanced representation across multiple source groups is logistically demanding and may introduce non-response bias if some groups are harder to engage.
- Consensus does not equal correctness — the technique surfaces collective expert opinion, not empirical truth, and may perpetuate shared blind spots.
- Multiple rounds with heterogeneous panels lengthen the study timeline; attrition between rounds can unbalance the source representation that was carefully constructed at the outset.
- The definition of 'consensus' varies across studies (threshold, metric, and scale differ widely), making cross-study comparisons difficult.
- Findings are not statistically generalizable to broader populations; the panel is a purposive expert sample, not a probability sample.
Frequently asked
How is the Multi-source Delphi different from a standard Delphi?
A standard Delphi recruits experts with broadly similar backgrounds (e.g., specialists in one field) and focuses on reaching consensus within that group. The Multi-source variant deliberately samples from multiple distinct stakeholder groups or institutional sources and treats source-group balance as a core design requirement. Importantly, inter-group variation in ratings is reported as a substantive finding, not merely as noise around the aggregate.
How many source groups and panellists are needed?
There is no universal rule, but each source group typically needs at least 5–7 participants to provide stable sub-group statistics. A total panel of 15–50 is common in published studies. The number of source groups should reflect the genuine stakeholder landscape of the research question rather than a target number; two or three clearly distinct groups are sufficient if those groups cover the knowledge space.
How do I define consensus?
Consensus thresholds must be set a priori in the study protocol. Common criteria include ≥70% agreement on a dichotomous accept/reject scale, a median of ≥7 on a 9-point importance scale combined with an interquartile range of ≤2, or stability of median ratings between consecutive rounds (change of ≤0.5 scale points). The choice should be justified by reference to prior Delphi literature in your domain.
Can I run a Multi-source Delphi online?
Yes, and most contemporary studies do. Online platforms (survey tools, purpose-built Delphi software) facilitate anonymous multi-round data collection across geographically dispersed source groups and simplify the production of individualised feedback reports. The key principle — that panellists cannot identify one another's responses — must be upheld regardless of platform.
What should I do if a source group drops out between rounds?
Report attrition by source group at every round. If the dropout reduces a source group below 5 participants, consider whether the remaining panel still satisfies the multi-source design rationale. In some cases it is appropriate to pause the study, replace panellists from that source, and re-run the affected round; in others, transparency about the limitation is the most honest response. Dropping out entirely and presenting the surviving data as a balanced multi-source consensus is not acceptable.
Sources
- Linstone, H. A., & Turoff, M. (Eds.). (1975). The Delphi Method: Techniques and Applications. Addison-Wesley. link ↗
- Hasson, F., Keeney, S., & McKenna, H. (2000). Research guidelines for the Delphi survey technique. Journal of Advanced Nursing, 32(4), 1008–1015. DOI: 10.1046/j.1365-2648.2000.t01-1-01567.x ↗
How to cite this page
ScholarGate. (2026, June 3). Multi-source Delphi Technique. ScholarGate. https://scholargate.app/en/survey-methodology/multi-source-delphi-technique
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Delphi TechniqueSurvey Methodology↔ compare
- Focus GroupQualitative↔ compare
- Nominal Group TechniqueQualitative↔ compare