Process / pipelineFutures Foresight StudiesFutures studies / expert judgment and survey methodologyPipeline

Real-Time Delphi

Also known as: RT Delphi, Round-less Delphi, Real-Time Delphi Method, Continuous Delphi

OriginatorTheodore J. Gordon & Adam PeaseYear2006Sources2Related methods4

Real-Time Delphi is a roundless, asynchronous, computer-mediated reinvention of the classic Delphi method, developed by Theodore Gordon and Adam Pease in 2006. Where conventional Delphi proceeds through discrete questionnaire rounds — collect, aggregate, redistribute, repeat — Real-Time Delphi collapses the rounds entirely: experts log in to an online platform whenever they choose, see the panel's current aggregate estimates and the rationales behind them, and revise their own answers continuously, with the aggregate updating live as they do. This always-on feedback architecture preserves the core Delphi virtues of anonymity and structured feedback while removing the long delays, fixed schedules, and administrative burden of round-based administration. As described by Gordon and Pease and catalogued in the Millennium Project's Futures Research Methodology, the method makes large, distributed, and time-pressured expert elicitations practical, letting a panel converge through continuous interaction rather than through a rigid sequence of rounds.

Key highlights

  • Eliminates discrete rounds, collapsing the collect-aggregate-redistribute cycle into continuous interaction and dramatically cutting study duration.
  • Provides always-on, live aggregate and rationale feedback, so experts react to the panel's current state rather than to stale, batched summaries.
  • Scales efficiently to large, dispersed panels and many items by automating aggregation and removing the administrative burden of round management.
  • Preserves the core Delphi protections of anonymity and structured feedback, letting experts revise freely without conformity pressure or loss of face.

Intuition

This section is available to Pro members. Upgrade to Pro

How it works

This section is available to Pro members. Upgrade to Pro

When to use it

Use Real-Time Delphi when you need structured, anonymous expert judgment on questions about the future — forecasts, probabilities, impacts, timing — but the delays, fixed schedules, and administrative overhead of round-based Delphi are impractical. It is especially valuable for large or geographically dispersed panels, for time-sensitive elicitations where waiting weeks for rounds to close is unacceptable, and for studies with many items where managing repeated questionnaire cycles by hand would be prohibitive. The method suits experts who can engage on their own schedule and a context where a suitable online platform is available. It is less appropriate when the panel is small enough that round-based administration is trivial, when participants lack reliable access to or comfort with the online tool, or when the deliberation genuinely benefits from synchronized, facilitated discussion rather than asynchronous self-paced revision. Because it relies on continuous self-driven participation, it also needs design care to keep experts returning and to avoid premature settling driven by early movers.

Strengths & limitations

Strengths
  • Eliminates discrete rounds, collapsing the collect-aggregate-redistribute cycle into continuous interaction and dramatically cutting study duration.
  • Provides always-on, live aggregate and rationale feedback, so experts react to the panel's current state rather than to stale, batched summaries.
  • Scales efficiently to large, dispersed panels and many items by automating aggregation and removing the administrative burden of round management.
  • Preserves the core Delphi protections of anonymity and structured feedback, letting experts revise freely without conformity pressure or loss of face.
Limitations
  • Continuous, self-paced participation can be uneven, and a few early or frequent contributors may anchor the aggregate before later experts engage.
  • Convergence is harder to define and control than a fixed round count, and a study may settle prematurely or fail to settle within the available time.
  • It depends on a capable online platform and on participants' access to and comfort with it, which can constrain or bias the panel.
  • Asynchronous revision sacrifices the synchronized, facilitated deliberation that some complex problems benefit from, and lighter engagement per item can mean shallower reasoning.

Common pitfalls

This section is available to Pro members. Upgrade to Pro

Applications

This section is available to Pro members. Upgrade to Pro

Frequently asked

How is Real-Time Delphi different from a generic Delphi study?

The defining difference is the elimination of rounds. Classic Delphi proceeds in discrete iterations: experts answer, an administrator collects and summarizes, the summary is sent back, and experts answer again — a slow, scheduled, batch process. Real-Time Delphi makes the platform continuously available, so experts see the panel's current aggregate and rationales whenever they log in and can revise their estimates at any moment, with the aggregate updating live. There are no rounds to wait for and no administrator compiling results between iterations. This roundless, always-on feedback architecture is the essence of the method; everything else — anonymity, statistical aggregation, reasoned feedback — it inherits from classic Delphi.

Does removing rounds compromise the quality of the consensus?

Not inherently, provided the design is sound. The features that give Delphi its quality — anonymity, structured statistical feedback, and the exchange of rationales rather than raw numbers — are all preserved; what changes is the timing, from batched to continuous. The genuine risks are different: early contributors can anchor the running aggregate, and a study can settle before everyone has engaged. Good practice counters these by encouraging broad early participation, surfacing dissenting rationales prominently, requiring written justifications, and stopping on demonstrated stability rather than a fixed clock. Handled this way, Real-Time Delphi can match round-based Delphi's quality while being far faster and more scalable.

What stops a Real-Time Delphi study from running forever?

Two things. First, the study has a preset end time, an outer bound after which it closes regardless. Second and more importantly, it is designed to stop when the panel reaches equilibrium — when continuous revisions die down and the aggregate stops moving meaningfully, signalling that further interaction is unlikely to change the result. This stability-based termination is more natural than the arbitrary round counts of classic Delphi: the study lasts exactly as long as productive revision continues. Monitoring the rate of change in estimates tells the administrator when convergence has effectively been reached and the elicitation can be closed.

Sources

  1. 1.
    Gordon, T., & Pease, A. (2006). RT Delphi: An efficient, round-less almost real time Delphi method. Technological Forecasting and Social Change, 73(4), 321-333.
  2. 2.
    Glenn, J. C., & Gordon, T. J. (Eds.). (2009). Futures Research Methodology, Version 3.0. The Millennium Project.
    ISBN 9780981894119

You have read it. What now?

Cite this page

ScholarGate. (2026, June 23). Real-Time Delphi. ScholarGate. https://scholargate.app/futures-foresight-studies/real-time-delphi