방법 비교

	실용적 A/B 테스트	A/B 테스트 (온라인 통제 실험)	전요인 실험 설계
분야	실험설계	실험설계	실험설계
계열	Process / pipeline	Hypothesis test	Hypothesis test
기원 연도	1967 (pragmatic framing); 2007–2012 (large-scale tech A/B testing practice)	1935	1926
창시자	Pragmatic trial framing: Schwartz & Lellouch (1967); A/B testing in technology: Ron Kohavi and colleagues at Microsoft (~2007–2012)	Ron Kohavi et al. (Microsoft); conceptual roots in R. A. Fisher's randomized experiments (1935)	R. A. Fisher
유형	Randomized comparative experiment	Parametric comparison (frequentist or Bayesian)	Parametric factorial experiment
원전	Schwartz, D., & Lellouch, J. (1967). Explanatory and pragmatic attitudes in therapeutical trials. Journal of Chronic Diseases, 20(8), 637–648.	Kohavi, R., Tang, D., & Xu, Y. (2020). Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing. Cambridge University Press. ISBN: 9781108724265	Box, G. E. P., Hunter, J. S., & Hunter, W. G. (2005). Statistics for Experimenters: Design, Innovation, and Discovery (2nd ed.). Wiley. ISBN: 978-0471718130
별칭	pragmatic split test, real-world A/B experiment, pragmatic online experiment, pragmatic controlled experiment	split test, controlled experiment, two-variant test, A/B Testi (Online Kontrollü Deney)	factorial experiment, 2^k factorial, full factorial, Faktöriyel Deneme Deseni (Full Factorial, 2^k)
관련	3	4	5
요약	A pragmatic A/B test is a randomized comparative experiment that evaluates two alternatives — a control (A) and a treatment (B) — under real-world operating conditions rather than tightly controlled laboratory settings. Rooted in the pragmatic-versus-explanatory trial distinction introduced by Schwartz and Lellouch in 1967 and brought to large-scale practice by online experimentation teams at Microsoft, Google, and Amazon, it prioritizes decision-relevant effectiveness over internal mechanistic explanation.	An A/B test is a randomized controlled experiment that simultaneously exposes two groups of users to a control variant (A) and a treatment variant (B) in order to determine whether a measured outcome differs significantly between them. The modern online controlled experiment framework was systematized by Ron Kohavi and colleagues at Microsoft in the early 2000s, building on R. A. Fisher's classical randomization principles from 1935. It is the dominant causal inference tool in web product development, digital marketing, and experimentation platforms.	A full factorial design is a parametric experimental method in which every combination of factor levels is tested simultaneously, enabling the estimation of all main effects and all interaction effects in a single study. Rooted in R. A. Fisher's foundational work on designed experiments (1926) and systematically developed by Box, Hunter, and Hunter (2005) and Montgomery (2017), the 2^k form tests k two-level factors across 2^k experimental runs and is the benchmark against which all other factorial designs are measured.