Process / pipelineDeneysel desen

Pilot A/B Test — Preliminary Split-Test Experiment

A Pilot A/B test is a small-scale, preliminary split-test experiment run before a full A/B test to assess feasibility, estimate effect sizes, detect operational problems, and validate measurement instruments. Participants are randomly assigned to a control condition (A) and a treatment condition (B), but the study is explicitly underpowered — its purpose is to inform the design of the definitive test, not to yield a conclusive comparison.

Find Topic with PaperMindSoonVideoSoon

Read the full method

Members only

Sign in with a free account to read this section.

Sign in

Sources

  1. Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., Robson, R., Thabane, M., Giangregorio, L., & Goldsmith, C. H. (2010). A tutorial on pilot studies: The what, why and how. BMC Medical Research Methodology, 10(1), 1. DOI: 10.1186/1471-2288-10-1
  2. Kohavi, R., Longbotham, R., Sommerfield, D., & Henne, R. M. (2009). Controlled experiments on the web: Survey and practical guide. Data Mining and Knowledge Discovery, 18(1), 140-181. DOI: 10.1007/s10618-008-0114-1

Related methods

ScholarGatePilot A/B Test (Pilot A/B Test (Preliminary Split-Test Experiment)). Retrieved 2026-06-04 from https://scholargate.app/en/experimental-design/pilot-ab-test