Process / pipelineQualitativePipeline

Delphi Method — Structured Expert Consensus

Also known as: Delphi Yöntemi, Delphi technique, expert consensus method

OriginatorNorman Dalkey & Olaf Helmer (RAND Corporation)Year1963Sources1Related methods12

The Delphi method is a structured, iterative survey technique developed by Norman Dalkey and Olaf Helmer at the RAND Corporation in 1963 for eliciting and converging expert opinion on complex topics where empirical data are unavailable or insufficient. It collects independent judgements from a geographically dispersed expert panel over multiple anonymous rounds, feeding aggregated results back to participants after each round so they can revise their views in light of the group's collective position.

Key highlights

  • Anonymity neutralises social dominance and authority bias, allowing quieter experts to contribute on equal footing.
  • Controlled, structured feedback guides the panel toward reasoned convergence rather than group-think conformity.
  • Participants can be geographically dispersed, making it practical when assembling a face-to-face panel is impractical or costly.
  • The iterative structure is transparent and auditable: each round's data can be reported, showing how views shifted.
  • Works well for priority-setting and criterion-weighting tasks where no gold-standard empirical answer exists.

Intuition

This section is available to Pro members. Upgrade to Pro

How it works

This section is available to Pro members. Upgrade to Pro

When to use it

Use the Delphi method when empirical data are scarce or unavailable and expert opinion is the most defensible evidence base; when you need structured forecasts, priority lists, or criterion weighting for policy, clinical guideline, or strategic planning purposes; and when participants are dispersed and cannot meet face-to-face. The minimum viable panel is 10 experts, and at least two questionnaire rounds must be planned. If the question can be answered with existing quantitative data, a statistical analysis is more appropriate. If you need real-time deliberation among a small, co-located group, a focus group or nominal group technique is a better fit.

Strengths & limitations

Strengths
  • Anonymity neutralises social dominance and authority bias, allowing quieter experts to contribute on equal footing.
  • Controlled, structured feedback guides the panel toward reasoned convergence rather than group-think conformity.
  • Participants can be geographically dispersed, making it practical when assembling a face-to-face panel is impractical or costly.
  • The iterative structure is transparent and auditable: each round's data can be reported, showing how views shifted.
  • Works well for priority-setting and criterion-weighting tasks where no gold-standard empirical answer exists.
Limitations
  • Requires a minimum panel of 10-15 experts; with fewer participants, consensus statistics become unreliable.
  • The process is slow: multiple questionnaire rounds with inter-round analysis can span weeks or months.
  • The quality of consensus depends entirely on the quality of the expert panel; a poorly recruited panel produces poorly grounded results.
  • Pre-defining the consensus threshold is methodologically important but inherently arbitrary; different thresholds can yield different 'consensus' outcomes.
  • Response attrition across rounds is common; panellists who drop out may bias the final consensus.

Common pitfalls

This section is available to Pro members. Upgrade to Pro

Applications

This section is available to Pro members. Upgrade to Pro

Frequently asked

How many rounds does a Delphi study need?

At least two rounds are required — one to elicit initial positions and one to allow revision in light of group feedback. Most published Delphi studies use two or three rounds. A third round is warranted when consensus has not been reached after round two and the IQR has been narrowing; beyond three rounds, attrition risk typically outweighs the benefit of continued iteration.

What panel size is appropriate?

The source literature sets a practical minimum of 10-15 experts. A panel below 10 produces unreliable distribution statistics and the method loses its inferential basis. There is no fixed upper bound, but panels above 30 generate administrative complexity with diminishing returns on consensus quality. Panel diversity — across sub-disciplines and institutional contexts — matters more than sheer size.

How is consensus defined?

The most common operational definition is an interquartile range (IQR) of 1 or less on a five- or seven-point Likert scale, or 70-80 percent of panellists rating within a specified range. Crucially, the threshold must be defined in the study protocol before data collection, not selected post hoc to fit the results.

When should I use a focus group instead of a Delphi study?

If your expert panel is small (under 10 people), co-located, and real-time deliberation is feasible, a focus group or nominal group technique is more appropriate. The Delphi method's advantages — anonymity and geographic flexibility — only materialise with a panel large enough to make distribution statistics meaningful and dispersed enough to prevent face-to-face assembly.

Sources

  1. 1.
    Dalkey, N. & Helmer, O. (1963). An Experimental Application of the Delphi Method to the Use of Experts. Management Science, 9(3), 458-467.

You have read it. What now?

Cite this page

ScholarGate. (2026, June 1). Delphi Method. ScholarGate. https://scholargate.app/qualitative/delphi-method

Delphi Method — Delphi Method (Structured Expert Consensus)