Adaptive Experiment — Adaptive Experimental Design
Adaptive Experimental Design · Also known as: adaptive design, response-adaptive randomization, adaptive trial, adaptive randomization
An adaptive experiment is an experimental design in which pre-specified rules allow the protocol to be modified — such as reallocating participants to better-performing arms, stopping early for efficacy or futility, or changing sample size — based on accumulating interim data, while maintaining statistical validity. Adaptive designs are widely used in clinical trials, behavioural economics, and online platform testing to improve efficiency and ethics without sacrificing inferential rigour.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
+13 more
When to use it
Use an adaptive experiment when: (1) interim data are observable before the study ends and can inform design adjustments; (2) there is genuine uncertainty about which treatment arms are most promising, making it wasteful or unethical to maintain fixed equal allocation throughout; (3) sample size assumptions are uncertain and a mid-study reassessment would improve power. It is most common in clinical trials, but increasingly used in online A/B testing, behavioural science, and policy evaluations. Do NOT use an adaptive design when: the outcome is only observable after the study ends (no meaningful interim data); the adaptation rules cannot be pre-specified; or the regulatory or institutional context requires a fixed-design approach. Adaptive designs require greater upfront statistical expertise than fixed designs — if the team cannot lock adaptation rules into a pre-registered protocol, a conventional RCT is more appropriate.
Strengths & limitations
- Improves efficiency — can require fewer participants than a fixed design to reach the same conclusion when early results are informative.
- Ethical advantage — reduces exposure of participants to inferior conditions by reallocating allocation away from underperforming arms.
- Flexibility — sample size reassessment guards against underpowered or overlong studies caused by uncertain initial assumptions.
- Multi-arm capability — supports seamless Phase II/III or platform trial structures that add or drop arms as evidence accumulates.
- Can stop early for overwhelming efficacy or futility, saving time and resources.
- Requires pre-specification of all adaptation rules before data collection — any deviation compromises Type I error control.
- Statistical analysis is substantially more complex than for fixed designs; specialised software and expertise are required.
- Response-adaptive randomization can introduce operational bias if blinding is imperfect or if the adaptation is observable by participants or staff.
- Regulatory acceptance varies; in clinical contexts the adaptation plan must be negotiated with regulators before the trial begins.
- Logistical complexity increases — interim data cleaning, independent monitoring, and rapid protocol updates demand infrastructure.
Frequently asked
Is an adaptive experiment the same as a sequential trial?
Sequential analysis is the foundational statistical framework; adaptive experiments are a broader class that includes sequential stopping rules but also encompasses response-adaptive randomization, arm dropping, and sample size re-estimation. All sequential trials are adaptive in a minimal sense, but not all adaptive designs limit themselves to early stopping.
How do I control the Type I error rate across multiple interim analyses?
Pre-specify the interim look schedule and use a multiplicity-adjusted stopping boundary method such as the O'Brien-Fleming or Pocock boundary, or the alpha-spending function approach (Lan-DeMets). For Bayesian adaptive designs, calibrate decision thresholds via simulation to achieve the desired frequentist operating characteristics before the trial starts.
Can I use adaptive designs in social science research outside of clinical trials?
Yes. Response-adaptive randomization, multi-armed bandit algorithms, and group-sequential stopping rules have been applied in education research, behavioural economics, and online experimentation. The key requirement remains the same: adaptation rules must be pre-specified, and the final analysis must account for the adaptive sampling path.
What sample size do I need?
Sample size depends on the specific adaptation strategy, the primary estimand, the interim look schedule, and the desired power. Because the final sample size may itself be an adaptive quantity (in sample-size reassessment designs), simulation-based power analysis is typically required rather than a standard closed-form formula.
Does an adaptive design require regulatory pre-approval?
In regulated clinical trials (drug, device, biologics), yes — the adaptive design plan must be agreed with the relevant regulatory authority (FDA, EMA, etc.) before the study begins. In non-regulated research contexts there is no formal approval requirement, but pre-registration of the adaptation rules in a public registry (e.g., ClinicalTrials.gov, AsPredicted, OSF) is strongly recommended to ensure transparency and reproducibility.
Sources
- Chow, S. C., & Chang, M. (2008). Adaptive Design Methods in Clinical Trials. Chapman and Hall/CRC. ISBN: 978-1584886761
- U.S. Food and Drug Administration. (2019). Adaptive Designs for Clinical Trials of Drugs and Biologics: Guidance for Industry. FDA. link ↗
How to cite this page
ScholarGate. (2026, June 3). Adaptive Experimental Design. ScholarGate. https://scholargate.app/en/experimental-design/adaptive-experiment
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Factorial ExperimentExperimental design↔ compare
- Multi-arm experimentExperimental design↔ compare
- Randomized Controlled TrialExperimental design↔ compare
- Response Surface MethodologyExperimental design↔ compare
- Sequential AnalysisStatistics↔ compare