Cognitive Reflection Test
Also known as: CRT, Frederick Reflection Test, Cognitive Reflection
The Cognitive Reflection Test (CRT) is a brief measure of cognitive reflection—the ability to override intuitive, reflexive answers in favor of deliberate, analytical reasoning. Participants answer problems that have an intuitive but incorrect answer and a correct answer requiring reflection. The CRT reveals individual differences in the tendency to engage in slow, deliberate thinking (System 2) versus relying on fast, intuitive judgments (System 1). CRT scores predict performance on reasoning tasks, economic decisions, and susceptibility to cognitive biases.
Read the full method
Sign in with a free account to read this section.
When to use it
Use the CRT when assessing cognitive reflection, analytical thinking tendency, or susceptibility to cognitive biases. It is valuable in understanding individual differences in judgment and decision-making, predicting performance on reasoning tasks, examining how cognitive reflection mediates educational outcomes, and in behavioral economics research examining rationality.
Strengths & limitations
- Brief and efficient: typically 3-7 items, quick to administer in research or applied settings
- Predictive validity: CRT scores predict performance on cognitive bias tasks, reasoning, and numeracy beyond IQ
- Dual-process model grounding: measures tendency toward deliberate thinking, operationalizing System 2 engagement
- Minimal equipment needs: can be administered on paper, computer, or orally; accessible across settings
- Limited scope: three core items measure only one narrow slice of cognition; expanded versions (CRT-2) address this partially
- Ceiling effects in educated samples: high-education, math-oriented participants may show little variation; measures may work better in general population
- Practice and coaching effects: after seeing CRT items, individuals improve substantially; single administration recommended or alternate forms needed
- Cultural and linguistic differences: some translations or cultural contexts affect item difficulty; norms vary across populations
Frequently asked
What do low CRT scores indicate?
Low CRT scores indicate a tendency toward intuitive, reflexive reasoning. Low-scoring individuals are not unintelligent; they prefer to trust their instincts. In some contexts (expertise domains, time-pressured decisions), intuition is reliable. However, in novel, complex domains, low reflection correlates with errors and biases.
Is CRT a measure of IQ?
No, though CRT and IQ correlate (r ≈ 0.40-0.50). CRT measures the tendency to engage deliberate thinking, while IQ measures capacity for reasoning. Someone can be intelligent but prefer intuitive shortcuts, or less intelligent but reflective. CRT adds predictive power beyond IQ for reasoning and bias resistance.
Can I use the CRT with children?
Original CRT is designed for older adolescents and adults (ages 16+). Modified versions for younger children exist, but items need simplification. Children's developing metacognition and numeracy limit their reflection ability; interpretation differs from adult CRT.
How stable is CRT performance over time?
CRT scores are moderately stable (test-retest reliability ≈ 0.60-0.70 over months). However, practice, familiarity with puzzle types, and coaching improve scores. Use alternate forms or substantial intervals between administrations to assess reflection tendency longitudinally.
Sources
- Frederick, S. (2005). Cognitive reflection and decision making. Journal of Economic Literature, 43(4), 1047-1048. link ↗
- Primi, C., Morsanyi, K., Chiesi, F., Donati, M. A., & Hamilton, J. (2014). The development and testing of a new version of the Cognitive Reflection Test applying Item Response Theory (IRT). Journal of Behavioral Decision Making, 27(5), 397-411. DOI: 10.1002/bdm.1883 ↗
- Toplak, M. E., West, R. F., & Stanovich, K. E. (2011). The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks. Journal of Behavioral Decision Making, 24(2), 185-194. DOI: 10.3758/s13421-011-0104-1 ↗
How to cite this page
ScholarGate. (2026, June 3). Cognitive Reflection Test. ScholarGate. https://scholargate.app/en/psychology/cognitive-reflection-test