Questionnaire Design Principles

Rules for writing good questions

A well-designed questionnaire item is clear, specific, and answerable. It avoids leading, double-barrelled, ambiguous, and loaded wording, as well as unnecessary jargon. Response options must be exhaustive and mutually exclusive, question order must not introduce bias, and sensitive topics require careful handling. Pretesting is indispensable for ensuring measurement validity and reliability.

Defining the Concept

Questionnaire design principles are a set of rules and guidelines that ensure the items in a measurement instrument accurately and consistently capture the construct the researcher intends to measure. These principles cover every stage from question wording and response scale selection to page layout and question ordering. The primary goal is to ensure that respondents interpret each question in the same way the researcher intends, so that responses genuinely reflect the target concept. Because measurement error most often originates in poorly worded items, the design process requires both conceptual clarity and linguistic precision.

Core Principles and Application Steps

A good survey item should (1) measure a single idea — avoiding double-barrelled questions, (2) be written in language appropriate for the respondents, avoiding jargon and assumed knowledge, (3) be neutral — free of leading or emotionally loaded wording, and (4) be answerable by the target population. Response options must be mutually exclusive and exhaustive; options such as "other" or "no opinion" should be included where appropriate. Question ordering should move from general and neutral items toward sensitive or demographic questions. Different response formats — Likert scales, semantic differentials, ranking — should be chosen to match the nature of the construct being measured.

Concrete Example: The Leading Question Error

An example of a poorly designed item: "Do you agree with this practice, which the majority of researchers support?" The phrase "majority of researchers" creates social pressure and pre-frames the response, making the item leading. A corrected version reads: "To what extent do you find the following practice appropriate? (1 = Not at all appropriate … 5 = Completely appropriate)" Likewise, "Are you satisfied with the students' academic achievement and psychological wellbeing?" is double-barrelled and should be split into two separate items. These examples illustrate how a small change in wording can fundamentally affect measurement validity.

Common Pitfalls and Pretesting

The most common pitfalls include vague reference periods (use "in the past 30 days" rather than "recently"), negatively worded items ("Don't you agree that…?"), social desirability pressure, and asymmetric response scale options. Sensitive topics such as income, health, or sexual behaviour may require confidentiality assurances and indirect framing. The most reliable way to minimise these risks is pretesting: administering the questionnaire to a small, representative sample, documenting difficulties through cognitive interviewing techniques, and revising problematic items. A survey conducted without pretesting carries a serious risk of systematic measurement error.

Key terms

Double-Barrelled Question: A question that asks about two distinct issues simultaneously, making response interpretation ambiguous.
Leading Question: A question whose wording implies a preferred answer and nudges the respondent toward it.
Exhaustive and Mutually Exclusive Options: Response set design ensuring all possible answers are covered and each answer fits exactly one category.
Cognitive Interview: A pretesting technique where respondents think aloud to reveal how they interpret survey items.
Social Desirability Bias: Measurement error arising from respondents answering in socially acceptable rather than truthful ways.