Scott's Pi
Scott's pi is a chance-corrected coefficient of intercoder agreement for two coders working on a nominal scale, introduced by William Scott in 1955 specifically for content analysis. It improves on raw percent agreement by subtracting the agreement two coders would reach by chance, where chance is estimated from a single pooled distribution of categories shared by both coders rather than from each coder's separate marginals.
Source record
Citations copied verbatim from the method’s source record. No claim-level verification is inferred from them.
- Scott, W. A. (1955). Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly, 19(3), 321–325. · DOI 10.1086/266577
- Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. · DOI 10.1177/001316446002000104
- Krippendorff, K. (2004). Content Analysis: An Introduction to Its Methodology (2nd ed.). Thousand Oaks, CA: Sage. · ISBN 9780761915454
Curated claims
Claims persisted in the evidence ledger, each with its own assessment.
This view does not invent a claim assessment when the ledger has none.
Related methods
Generated from the method graph and shown as machine-suggested relations — no evidence claim is inferred.