Pilot Field Experiment — Small-Scale Experimental Trial in Real-World Settings
Pilot Field Experiment · Also known as: pilot field trial, small-scale field experiment, feasibility field experiment, exploratory field experiment
A pilot field experiment is a small-scale, preliminary version of a planned full field experiment conducted in a naturalistic setting. It tests whether the intervention, randomisation procedure, measurement instruments, and logistical protocols are feasible before committing to a full-scale study. Results inform sample size calculations, refine treatment protocols, and identify procedural risks — saving resources and improving the quality of the definitive study.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use a pilot field experiment when a full-scale randomised field trial is planned but key operational assumptions (recruitment capacity, intervention fidelity, instrument responsiveness) have not yet been tested in the target setting. It is especially valuable when the intervention is novel, the population is hard-to-reach, or the full study will be expensive. Do not use it as a substitute for a full trial when adequate power and definitive causal conclusions are required; pilot estimates of effect size are too imprecise to be the primary evidence base. Avoid running a pilot in a separate context that differs substantially from the full-study setting, as feasibility findings may not transfer.
Strengths & limitations
- Identifies recruitment and retention problems before they derail a fully funded study.
- Provides real-world fidelity data — how practitioners actually deliver the intervention, not just how they are trained to do so.
- Enables empirically grounded sample size calculations by yielding context-specific variance and attrition estimates.
- Allows iterative protocol refinement at low cost, improving internal validity of the subsequent full experiment.
- Surfaces unexpected contextual factors unique to the field setting that laboratory piloting cannot reveal.
- Insufficient statistical power to detect or reliably estimate the primary intervention effect.
- Findings are specific to the pilot site and sample; feasibility conclusions may not generalise to other sites or populations.
- Pilot effect-size estimates are notoriously unstable and should not be used as the primary basis for go/no-go decisions on intervention efficacy.
- Adds time and cost to the overall research programme, which may not be justified for interventions with a strong prior evidence base.
Frequently asked
Can I use the pilot data in the final analysis of the full study?
As a general rule, no. Including pilot participants in the full-study analysis inflates the type I error rate and can bias effect estimates because the protocol was likely modified after the pilot. Some statisticians allow inclusion under strict conditions with appropriate adjustments, but most reporting guidelines recommend keeping the samples separate.
How large should my pilot sample be?
There is no universal rule. Common guidance suggests 12–30 participants per arm for estimating feasibility parameters. Whitehead et al. (2016) recommend a minimum of 25 per arm when the goal is to estimate the standard deviation for a power calculation. The sample should be sized to answer the specific feasibility questions, not to detect the primary outcome.
What is the difference between a pilot study and a feasibility study?
The terms are often used interchangeably, but a useful distinction is that a pilot study is a small-scale version of the full study run in miniature (same design, smaller N), while a feasibility study answers specific 'can we do this?' questions that may not mirror the full design. In practice, many studies combine both elements.
Should I report a pilot field experiment even if I plan a full study?
Yes. Transparent reporting of pilot results — including feasibility benchmarks, protocol changes, and preliminary outcome data — helps the scientific community assess whether the full study is warranted and replicable. Journals such as Pilot and Feasibility Studies exist specifically for this purpose.
What if my pilot results show the intervention is unlikely to work?
A pilot is not powered to make that determination — a null or small effect in a pilot could simply reflect sampling variability. The decision to abandon the full study should rest on the pre-specified feasibility stop criteria (e.g., recruitment below 50% of target, adherence below 60%), not on the pilot p-value or point estimate of the primary outcome.
Sources
- Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Rand McNally. ISBN: 978-0395307878
- Leon, A. C., Davis, L. L., & Kraemer, H. C. (2011). The role and interpretation of pilot studies in clinical research. Journal of Psychiatric Research, 45(5), 626–629. DOI: 10.1016/j.jpsychires.2010.10.008 ↗
How to cite this page
ScholarGate. (2026, June 3). Pilot Field Experiment. ScholarGate. https://scholargate.app/en/experimental-design/pilot-field-experiment
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Cluster Randomized TrialClinical Research↔ compare
- Field ExperimentExperimental design↔ compare
- Randomized Controlled TrialExperimental design↔ compare