Longitudinal Differential Item Functioning (Longitudinal DIF)
Longitudinal Differential Item Functioning · Also known as: longitudinal DIF, DIF across time, temporal DIF, longitudinal item bias
Longitudinal differential item functioning detects whether individual test or scale items behave differently across measurement occasions for the same respondents. It extends standard DIF methodology to repeated-measures designs, ensuring that observed change scores genuinely reflect construct change rather than shifts in item characteristics over time.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use longitudinal DIF whenever you compare scale scores or latent trait estimates across two or more occasions for the same sample — panel studies, pre-post intervention designs, ecological momentary assessment, and growth-curve research all qualify. It is particularly critical when substantive conclusions hinge on the magnitude of change (effect sizes, growth trajectories) rather than merely its direction. Do not skip longitudinal DIF analysis simply because a cross-sectional DIF check showed no problems: item behavior can shift across time even when it is stable across demographic groups. Longitudinal DIF is less informative — and computationally difficult to identify — when the number of occasions is very small (fewer than two anchor points for comparison) or when the sample per occasion is too small to achieve stable parameter estimates (a rough minimum is n = 200 per occasion for IRT-based approaches).
Strengths & limitations
- Directly addresses measurement bias in repeated-measures designs, protecting the validity of longitudinal change inferences.
- Applicable within both IRT and CFA frameworks, allowing integration with mainstream longitudinal modeling pipelines.
- Partial invariance solutions allow retention of DIF items with freed parameters, preserving statistical power while correcting bias.
- Provides actionable diagnostic information — item-specific, occasion-specific — that guides scale revision for future waves.
- Identifies practice effects and response-shift artifacts that would otherwise contaminate observed growth trajectories.
- Requires adequate sample size at each occasion; small panels yield unstable DIF estimates and inflated false-positive rates.
- Identifying DIF depends on a set of anchor items assumed to be DIF-free; incorrect anchor specification biases all comparisons.
- Multiple testing across many items and occasions inflates Type I error unless corrections (Bonferroni, BH) are applied systematically.
- Non-uniform longitudinal DIF is harder to detect and interpret than uniform DIF, and standard chi-square tests have lower power for it.
- Distinguishing true longitudinal DIF from genuine construct change over time is conceptually and statistically challenging.
Frequently asked
How is longitudinal DIF different from measurement invariance testing?
They address the same core question — stability of item parameters across occasions — but at different levels of granularity. Measurement invariance testing typically evaluates whether entire sets of loadings and intercepts are equal across time (configural, metric, scalar hierarchy). Longitudinal DIF analysis focuses on individual items, identifying which specific items are non-invariant and quantifying the size of each item's departure, making it more diagnostic and actionable.
Can I run longitudinal DIF if I have only two time points?
Yes, two occasions is the minimum. With only two time points, the comparison is straightforward — parameters at occasion 2 are tested against those at occasion 1. However, power to detect small DIF effects is lower with two points than with three or more, and you cannot distinguish a gradual drift from an abrupt shift. Three or more occasions are preferred whenever feasible.
Which software can I use for longitudinal DIF analysis?
CFA-based longitudinal DIF can be estimated in Mplus, lavaan (R), or OpenMx using multi-group or multi-occasion SEM syntax. IRT-based approaches are available in the ltm, mirt, and TAM packages in R. StatWise automates the model sequence, anchor selection, and effect-size reporting within an integrated workflow.
What do I do when I find significant longitudinal DIF in several items?
First, assess the practical magnitude using effect-size criteria. If DIF is large, consider removing those items from the longitudinal composite or refitting the model under partial invariance — freeing only the DIF parameters while keeping the remaining items constrained. Partial invariance still allows meaningful comparison of latent means provided at least two or three anchor items per factor remain DIF-free.
Is longitudinal DIF the same as response-shift analysis?
They overlap substantially but are not identical. Response-shift analysis (Schwartz & Sprangers, 1999) is a broader theoretical framework distinguishing recalibration, reprioritization, and reconceptualization of constructs over time. Longitudinal DIF is one specific statistical tool — among others such as response-shift SEM — used to detect and quantify measurement non-equivalence across occasions, which corresponds primarily to the recalibration component of response shift.
Sources
- Millsap, R. E., & Kwok, O. M. (2004). Evaluating the impact of partial factorial measurement invariance on selection in two groups. Psychological Methods, 9(1), 93–115. DOI: 10.1037/1082-989X.9.1.93 ↗
- Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. DOI: 10.1177/109442810031002 ↗
How to cite this page
ScholarGate. (2026, June 3). Longitudinal Differential Item Functioning. ScholarGate. https://scholargate.app/en/psychometrics/longitudinal-differential-item-functioning
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Differential Item FunctioningPsychometrics↔ compare
- Item Response TheoryPsychometrics↔ compare
- Longitudinal CFAPsychometrics↔ compare
- Longitudinal IRTPsychometrics↔ compare
- Longitudinal Measurement InvariancePsychometrics↔ compare
- Measurement InvariancePsychometrics↔ compare