Pesaran-Timmermann Test of Directional Predictive Accuracy
Also known as: PT Test, Directional Accuracy Test, Nonparametric Predictive Performance Test, Pesaran-Timmermann Yön Testi
Introduced by Pesaran and Timmermann (1992), the PT test is a nonparametric procedure that evaluates whether a forecasting model correctly predicts the direction (sign) of a target variable more often than would be expected by chance. It is widely used in financial econometrics and macroeconomic forecasting to assess the practical utility of a model beyond simple error metrics, particularly when the economic cost of getting the direction wrong is high.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use the PT test when the primary concern is directional accuracy rather than magnitude of forecast errors, for example in predicting stock return signs, exchange rate movements, recession indicators, or business cycle turning points. The test assumes that observations are independently and identically distributed under the null; applying it to serially correlated data or rolling-window forecasts may require bootstrap modifications. It is not suitable when zero-valued outcomes are frequent, as sign classification is ambiguous at zero. For magnitude-based comparisons, prefer the Diebold-Mariano test; for turning-point analysis, consider dedicated turning-point tests.
Strengths & limitations
- Nonparametric and distribution-free under the null, requiring no assumptions about the error distribution of the forecasting model.
- Directly measures economically relevant directional skill, which can matter more than MSE in trading or policy decision contexts.
- Simple closed-form statistic with a standard normal limiting distribution, making inference computationally trivial.
- Robust to model misspecification because it uses only the signs of forecasts and realizations, not their magnitudes.
- Ignores the magnitude of forecast errors, so a model that is directionally accurate but badly wrong in size will pass the test despite poor predictive quality.
- The asymptotic normal approximation can be unreliable in small samples; simulation or bootstrap critical values are advisable when T is less than roughly 30–50.
- Does not account for serial correlation in the hit sequence; autocorrelated forecast errors may inflate the test statistic under the null.
- Cannot handle ties (zero realizations or zero forecasts) without an ad hoc convention, potentially biasing results in low-frequency macroeconomic data.
Frequently asked
How does the PT test differ from the Diebold-Mariano test?
The Diebold-Mariano test compares the mean forecast loss (e.g., MSE or MAE) of two competing models, focusing on error magnitude. The PT test instead evaluates whether the sign of the forecast matches the sign of the realization more often than chance, making it complementary to loss-based tests and particularly relevant when directional accuracy carries direct economic value.
Can the PT test be used with overlapping or rolling-window forecasts?
The original asymptotic theory assumes i.i.d. observations under the null. Overlapping or rolling-window forecasts introduce serial correlation in the hit sequence, invalidating standard critical values. In those settings, block bootstrap or heteroskedasticity-and-autocorrelation-consistent variance estimators should replace the analytic variance formula.
What should be done when the realization or forecast is exactly zero?
A zero outcome has no unambiguous sign. Common conventions include excluding zero observations from the count, treating zero as a missed prediction, or using a three-category sign function that maps zero to its own class. The choice should be reported transparently, as it can materially affect the hit rate and test conclusion in low-frequency data.
Sources
- Pesaran, M. H., & Timmermann, A. (1992). A simple nonparametric test of predictive performance. Journal of Business & Economic Statistics, 10(4), 461–465. DOI: 10.1080/07350015.1992.10509922 ↗
How to cite this page
ScholarGate. (2026, June 2). Pesaran-Timmermann Test of Directional Predictive Accuracy. ScholarGate. https://scholargate.app/en/econometrics/pesaran-timmermann-test
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
Compare side by side →