How many users are needed for a usability test?

Jakob Nielsen famously argued that around five users uncover the majority of usability problems in qualitative testing, so iterative testing with small groups is efficient. Quantitative measurement of usability metrics, however, requires larger samples.

What is heuristic evaluation?

Heuristic evaluation is a usability inspection method in which evaluators judge an interface against a set of established usability principles, or heuristics, to identify likely problems without involving end users.

Usability and User Research in Design

Usability and user research provide the evidence base for design, studying how people understand and use products and how usable those products are.

Definition

Usability and user research in design is the study and evaluation of how usable products are and how people understand and use them, generating evidence to inform design.

Scope

This topic covers usability as a quality attribute (learnability, efficiency, memorability, errors, and satisfaction), methods for evaluating it such as heuristic evaluation and usability testing, and user research methods including interviews, contextual inquiry, surveys, and analytics. It addresses how qualitative and quantitative evidence about users informs and validates design decisions.

Core questions

What makes a product usable, and how can usability be measured?
How are usability evaluations such as heuristic review and usability testing conducted?
Which research methods reveal user needs, behaviours, and contexts?
How is research evidence translated into actionable design decisions?

Key theories

Usability engineering and heuristics: Nielsen formalised usability as a measurable set of attributes and introduced discount methods such as heuristic evaluation and small-sample testing that make usability work practical within real projects.
Common-sense usability: Krug distils usability into the principle that interfaces should be self-evident and not make users think, advocating frequent, low-cost testing to catch problems early.

History

Usability engineering emerged from human factors and HCI in the 1980s and 1990s, with Jakob Nielsen popularising cost-effective methods such as heuristic evaluation and the claim that small samples reveal most usability problems. As digital products proliferated, user research broadened to include ethnographic, generative, and analytics methods alongside evaluative usability testing.

Debates

Sample size and rigour: Whether small-sample 'discount' usability testing, as Nielsen advocates, is sufficient for design decisions, or whether larger and more rigorous studies are needed, especially for quantitative claims and high-stakes products.

Key figures

Jakob Nielsen
Steve Krug
Jeffrey Rubin
Dana Chisnell

Seminal works

nielsen1994
krug2014
rubin2008

Frequently asked questions

How many users are needed for a usability test?: Jakob Nielsen famously argued that around five users uncover the majority of usability problems in qualitative testing, so iterative testing with small groups is efficient. Quantitative measurement of usability metrics, however, requires larger samples.
What is heuristic evaluation?: Heuristic evaluation is a usability inspection method in which evaluators judge an interface against a set of established usability principles, or heuristics, to identify likely problems without involving end users.