Study Designs and Types of Evidence
Study designs are the structured plans researchers use to generate evidence about health and health care, and they differ in how they assemble groups, measure exposures and outcomes, and guard against error. Evidence-based practice and health technology assessment rest on being able to tell these designs apart and to judge how much confidence each can support.
Definition
A study design is the methodological framework that specifies how participants are selected, how comparison groups are formed, whether and how exposures or interventions are assigned, and how outcomes are measured, thereby determining the type and strength of evidence a study can yield.
Scope
This area orients the reader to the main families of health research design and the kinds of evidence they produce: experimental designs such as the randomized controlled trial, observational designs such as cohort and case-control studies, quasi-experimental and natural-experiment approaches, and qualitative research. It also touches on how individual studies are appraised and graded into an evidence hierarchy. It is a reference overview, not clinical guidance.
Sub-topics
Core questions
- What distinguishes experimental from observational and qualitative designs?
- How does a design's structure shape the strength and the limitations of its evidence?
- How are individual studies appraised and combined into graded evidence for decisions?
Key concepts
- Experimental versus observational designs
- Internal and external validity
- Bias and confounding
- Evidence hierarchy
- GRADE certainty of evidence
- Quantitative versus qualitative evidence
- Reporting standards
Mechanisms
Designs differ chiefly in how comparison is created. Randomized trials assign the intervention by chance, which on average balances known and unknown confounders; observational designs let exposure occur naturally and must therefore control confounding by design or analysis; quasi-experiments exploit non-random but structured variation; and qualitative methods seek meaning and process rather than measured association. These structural differences are what evidence hierarchies and grading systems such as GRADE attempt to translate into a graded confidence in findings.
Clinical relevance
Recognizing study designs underpins evidence appraisal across the health sciences: it lets readers weigh how much a given result should influence a body of evidence. This area describes how evidence is produced and judged and is not itself a basis for individual diagnostic or treatment decisions.
Evidence & guidelines
Hierarchies of evidence and grading frameworks formalize how design relates to confidence. The GRADE approach rates certainty of evidence and strength of recommendations across designs (Guyatt et al., 2008), while reporting standards such as PRISMA structure how the resulting evidence is synthesized and reported (Page et al., 2021). Foundational accounts of evidence-based medicine (Sackett et al., 1996) and of the relative roles of randomized and observational designs (Concato et al., 2000) frame the area.
History
The modern framing of design-based evidence grew out of mid-twentieth-century clinical epidemiology and the evidence-based medicine movement of the 1990s, which made explicit appraisal of study design central to clinical decision-making (Sackett et al., 1996). Subsequent work refined how the long-assumed superiority of randomized over observational evidence should be interpreted (Concato et al., 2000) and produced consensus grading systems (Guyatt et al., 2008).
Debates
- How strictly should designs be ranked in a hierarchy of evidence?
- Traditional hierarchies place randomized trials above observational studies, but empirical comparisons have found that well-designed observational studies do not systematically overstate effects, prompting a more nuanced, question-dependent view of design and evidence.
Key figures
- David Sackett
- Gordon Guyatt
- John Concato
Related topics
Seminal works
- sackett-1996
- concato-2000
- guyatt-2008
Frequently asked questions
- What is an evidence hierarchy?
- It is a ranking of study designs by how well their structure protects against bias, traditionally placing randomized trials and their syntheses above observational studies; modern frameworks like GRADE treat it as a starting point that can be adjusted up or down based on study quality and context.
- Does a higher-ranked design always give a better answer?
- No. The most appropriate design depends on the question; for some questions observational or qualitative evidence is more feasible or more informative, and a poorly conducted trial can yield weaker evidence than a strong observational study.