Ecological Fallacy Diagnostics

Ecological fallacy diagnostics are the design and analysis tools used to detect, quantify, and avoid the bias that arises when associations measured on groups are mistakenly taken to hold for individuals. The problem was crystallized by W. S. Robinson (1950), who showed that the correlation between, say, immigrant share and illiteracy across U.S. states bore no resemblance to the correlation between being an immigrant and being illiterate among individuals, sometimes even reversing sign. Greenland and Morgenstern (1989) gave the modern account, decomposing ecological bias into within-group confounding, effect modification, and model misspecification, and clarifying that the ecological fallacy is not a single artifact but a family of cross-level biases. As a pipeline, the diagnostics contrast ecological and individual associations, attribute any discrepancy to its sources, model the within-group covariate distribution that aggregate analyses ignore, place bounds on the individual-level quantity, and where possible move to hybrid or multilevel designs that recover individual effects.