Validity and Reliability in Research
Research Validity and Reliability: Concepts and Assessment · Also known as: measurement validity, test-retest reliability, internal and external validity
Validity and reliability are two foundational concepts in research quality. Reliability refers to the consistency and reproducibility of measurements: do repeated applications of an instrument yield the same results? Validity refers to the truthfulness of inferences: does an instrument measure what it claims to measure, and do study findings answer the research question appropriately? Cronbach and Meehl (1955) distinguished construct validity from other validity types; Campbell and Stanley (1963) categorized internal and external validity threats in experimental designs; and Messick (1995) unified validity concepts as 'the degree to which evidence and theory support the intended interpretations of test scores.' Contemporary frameworks encompass multiple validity types (construct, criterion, content, internal, external) and reliability estimates tailored to measurement context.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Assess validity and reliability early in your research process: (1) When selecting measurement instruments, review published validity and reliability evidence; choose instruments with strong evidence. (2) When developing new instruments, pilot test and document reliability and validity evidence before full data collection. (3) When interpreting results, discuss study validity threats and what they imply for causal inferences or generalizability. (4) When comparing studies or conducting meta-analyses, scrutinize the validity and reliability of included studies; weight evidence from high-quality studies more heavily. (5) When making clinical or policy decisions based on research, appraise both the quality of evidence and its relevance to your context.
Strengths & limitations
- Clear validity and reliability concepts enable researchers and readers to evaluate measurement quality and study credibility.
- Explicit assessment of validity and reliability reduces overconfidence in findings and promotes appropriate interpretation.
- Distinguishing multiple validity types (content, construct, criterion, internal, external) provides granular understanding of evidence quality.
- Documented validity and reliability facilitate cumulative science: researchers can build on validated instruments and methods without redundant development.
- Qualitative validity concepts (credibility, dependability, transferability, confirmability) offer transparent criteria for evaluating qualitative research quality.
- Validity and reliability are not absolute; evidence is context-specific. An instrument valid in one population may not be valid in another.
- Assessing validity and reliability requires statistical expertise and access to published evidence; newly developed instruments lack established evidence.
- Some validity claims (construct validity, internal validity) require theoretical and empirical reasoning beyond statistical coefficients; judgment and debate are involved.
- Qualitative validity concepts are less standardized than quantitative reliability statistics; assessment is more subjective and open to interpretation.
Frequently asked
What Cronbach's α value indicates good internal consistency?
Cronbach's α > 0.70 is generally acceptable; α > 0.80 is good; α > 0.90 may indicate redundancy (too many similar items). α < 0.60 suggests poor internal consistency. However, α depends on the number of items and their correlations; consult field-specific standards. Always report α for your sample, not just for the original validation sample.
If a study is internally valid (causal), is it always externally valid (generalizable)?
No. A highly controlled lab experiment may have excellent internal validity (strong evidence for causality) but poor external validity (findings may not apply to real-world populations or settings). Conversely, observational field studies may have high external validity but lower internal validity. Ideally, you want both; in practice, trade-offs occur.
Can qualitative research be valid and reliable?
Yes, but terminology differs. Qualitative research attains credibility (findings ring true), dependability (methods are consistent and transparent), transferability (findings may apply elsewhere), and confirmability (findings are grounded in data). These parallel quantitative validity and reliability. Rigorous qualitative research meets these criteria through careful methods, documentation, and reflexivity.
What if I cannot access validity and reliability evidence for an instrument I want to use?
If the instrument is published but evidence is sparse, conduct a pilot study (n=30–50) to assess reliability in your population. Report limitations in the validity evidence for your sample. If the instrument is unpublished, treat it as newly developed and provide pilot validation data. Always acknowledge any gaps in evidence and their implications for interpreting results.
Sources
- Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin. link ↗
- Messick, S. (1995). Validity of psychological assessment: validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. DOI: 10.1037/0003-066X.50.9.741 ↗
- Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. DOI: 10.1037/h0040957 ↗
How to cite this page
ScholarGate. (2026, June 3). Research Validity and Reliability: Concepts and Assessment. ScholarGate. https://scholargate.app/en/research-methodology/validity-reliability-research
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Data Collection MethodsResearch Methodology↔ compare
- Research Design TypesResearch Methodology↔ compare