Process / pipelinePsychometricsScale developmentPipeline

Content Validity Ratio

Also known as: CVR, Content validity index, Expert judgment content validity, Lawshe CVR

OriginatorCharles H. LawsheYear1975Sources3Related methods11

The Content Validity Ratio (CVR) is a quantitative method developed by Charles Lawshe in 1975 for evaluating the extent to which items in a measurement instrument are relevant and representative of a target construct. The method aggregates expert panel judgments into a single validity coefficient for each item, enabling researchers to identify and retain only those items deemed essential by domain experts. CVR provides objective support for content validity claims during scale development.

Key highlights

  • Provides objective, quantitative support for content validity decisions rather than relying on subjective author judgment alone
  • Identifies items with strong expert consensus, increasing confidence in construct relevance
  • Computationally simple and transparent; critical values are well-established and available in published tables
  • Cost-effective compared to large empirical studies; requires only expert time, not participant data

Intuition

This section is available to Pro members. Upgrade to Pro

How it works

This section is available to Pro members. Upgrade to Pro

When to use it

The CVR method is appropriate early in scale development to screen a large item pool and focus on those with the strongest content validity. It is particularly useful for constructs requiring expert interpretation (e.g., clinical diagnoses, occupational competencies, specialized knowledge domains). CVR is commonly paired with other validity evidence (face validity, convergent/discriminant validity, criterion validity) in comprehensive instrument validation. It is less suitable for constructs well-understood by the general population or when expert panels are unavailable.

Strengths & limitations

Strengths
  • Provides objective, quantitative support for content validity decisions rather than relying on subjective author judgment alone
  • Identifies items with strong expert consensus, increasing confidence in construct relevance
  • Computationally simple and transparent; critical values are well-established and available in published tables
  • Cost-effective compared to large empirical studies; requires only expert time, not participant data
Limitations
  • Outcomes depend heavily on the quality, expertise, and representativeness of the panel; biased or non-expert panels yield unreliable results
  • Does not measure psychometric properties (reliability, discriminant validity) that require empirical data
  • Panel members may lack independence if they know each other or the scale developers, introducing response bias
  • Requires consensus among experts, which may be unattainable for novel or controversial constructs

Common pitfalls

This section is available to Pro members. Upgrade to Pro

Applications

This section is available to Pro members. Upgrade to Pro

Frequently asked

How many experts should I recruit for a CVR panel?

Lawshe (1975) recommended a minimum of 5 experts; however, 10–40 experts is preferred for better statistical power and confidence in results. The larger the panel, the more stringent the critical CVR value. For small organizations or niche expertise, 5–10 experts may be acceptable; balance statistical power with feasibility.

What is the critical value for CVR?

The critical value depends on panel size. For a panel of 5 experts, the minimum CVR is 0.99; for 10 experts, 0.62; for 20 experts, 0.42; for 40 experts, 0.29. Lawshe published a table of critical values based on one-tailed testing at the 0.05 significance level. Use the appropriate table value for your panel size.

Can I use a 4-point scale instead of 3-point for expert ratings?

Yes. The standard 3-point scale is (Essential, Useful but not essential, Not essential); a 4-point scale might add 'Not relevant.' Adjust your CVR calculation accordingly: only the most favorable response (Essential) counts as Ne. Some researchers advocate 4-point for better discrimination.

What should I do with items below the CVR threshold?

Items below the critical value have insufficient expert consensus and may be removed or revised. Before discarding, qualitatively review expert comments; some items may be misunderstood and benefit from rewording. Items rated as 'useful but not essential' by many experts merit discussion with the team before removal.

Sources

  1. 1.
    Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575.
  2. 2.
    Tristán-López, A. (2008). Modification of the content validity ratio. Revista Educación y Pedagogía, 20(48), 11-18.
  3. 3.
    Polit, D. F., & Beck, C. T. (2006). The content validity index: are you sure? Research in Nursing & Health, 29(5), 489-497.

You have read it. What now?

Cite this page

ScholarGate. (2026, June 3). Content Validity Ratio. ScholarGate. https://scholargate.app/psychometrics/content-validity-ratio

Content Validity Ratio | ScholarGate