List Experiment
Also known as: Item count technique, Unmatched count technique, Item count method, List randomization
The list experiment, also called the item count technique, is a survey design that measures the prevalence of a sensitive attitude or behavior without ever requiring any respondent to directly disclose it. Respondents are randomly split into two groups: a control group sees a list of innocuous items and reports only how many apply to them, while a treatment group sees the same list plus one sensitive item. Because respondents report only a count, no individual answer reveals their stance on the sensitive item, and the difference in average counts between the groups estimates the proportion holding the sensitive trait.
Key highlights
- Provides strong privacy protection because no respondent ever directly reveals the sensitive answer, reducing social-desirability and disclosure bias.
- The core difference-in-means estimator is unbiased under randomization and requires no distributional assumptions.
- Easily embedded in standard survey platforms and comprehensible to respondents, improving compliance relative to more complex indirect methods.
- Modern regression estimators recover multivariate relationships and predicted probabilities, not just a single prevalence number.
Intuition
This section is available to Pro members. Upgrade to Pro
How it works
This section is available to Pro members. Upgrade to Pro
When to use it
Use a list experiment when you need an aggregate prevalence estimate of a sensitive attitude or behavior that direct questioning would distort through social-desirability bias or fear of disclosure — racial prejudice, support for political violence, vote buying, corruption, or stigmatized health behaviors. It requires a moderately large sample because the difference-in-means estimator is statistically inefficient relative to direct questions. Do not use it when you need individual-level truth for every respondent, when the sample is small, or when a suitable non-sensitive control list cannot be constructed; in those cases the randomized response technique or endorsement experiments may fit better.
Strengths & limitations
- Provides strong privacy protection because no respondent ever directly reveals the sensitive answer, reducing social-desirability and disclosure bias.
- The core difference-in-means estimator is unbiased under randomization and requires no distributional assumptions.
- Easily embedded in standard survey platforms and comprehensible to respondents, improving compliance relative to more complex indirect methods.
- Modern regression estimators recover multivariate relationships and predicted probabilities, not just a single prevalence number.
- Statistically inefficient: estimating a prevalence to a given precision needs far larger samples than direct questioning.
- Vulnerable to ceiling and floor effects when control-item prevalences are too extreme, biasing the estimate and undermining privacy.
- Relies on the no-design-effect and no-liars assumptions, which can fail if the sensitive item shifts how respondents read the whole list.
- Can yield logically impossible negative prevalence estimates in finite samples, signaling assumption violations or noise.
Common pitfalls
This section is available to Pro members. Upgrade to Pro
Applications
This section is available to Pro members. Upgrade to Pro
Frequently asked
How is a list experiment different from the randomized response technique?
Both protect privacy, but mechanically differ. The list experiment hides the sensitive answer in an aggregate count across a control and treatment list, requiring random assignment between respondents. The randomized response technique randomizes within each respondent — a coin or die determines whether they answer the sensitive question or a neutral one — so privacy comes from the analyst not knowing which question was answered. List experiments are usually simpler for respondents to understand; randomized response can be more statistically efficient.
Why can a list experiment produce a negative prevalence estimate?
The difference-in-means estimator is unbiased but noisy, so in any finite sample it can fall below zero by chance, especially with small samples or a low true prevalence. A persistently negative estimate is more worrying: it usually signals a design failure such as a floor effect, deflation of the control list, or violation of the no-design-effect assumption, and should trigger the diagnostic checks rather than be reported as a substantive finding.
How many control items should the list contain?
Most designs use three to five control items. Too few items make it easy for a respondent reporting the maximum or minimum count to be exposed, harming privacy; too many increase response variance and reduce statistical power. The items should be chosen so their combined counts rarely hit the floor or ceiling and so they are not all positively correlated, which is best confirmed in a pilot.
Sources
- 1.Imai, K. (2011). Multivariate Regression Analysis for the Item Count Technique. Journal of the American Statistical Association, 106(494), 407–416.
- 2.Blair, G., & Imai, K. (2012). Statistical Analysis of List Experiments. Political Analysis, 20(1), 47–77.
- 3.Glynn, A. N. (2013). What Can We Learn with Statistical Truth Serum? Design and Analysis of the List Experiment. Public Opinion Quarterly, 77(S1), 159–172.
You have read it. What now?
Cite this page
ScholarGate. (2026, June 22). List Experiment. ScholarGate. https://scholargate.app/political-science/list-experiment