方法对比

	非平稳Transformer	状态空间模型（卡尔曼滤波器）
领域	深度学习	计量经济学
方法族	Machine learning	Regression model
起源年份	2022	1990
提出者	Yong Liu et al.	Harvey; Durbin & Koopman (state space treatment); Kalman filter
类型	Transformer-based time-series forecasting model	State space time series model
开创性文献	Liu, Y., Wu, H., Wang, J., & Long, M. (2022). Non-stationary transformers: Exploring the stationarity in time series forecasting. NeurIPS.	Harvey, A. C. (1990). Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge University Press.
别名	NS-Transformer, Non-stationary Transformer Network, Stationarization-based Transformer, Durağan-Olmayan Transformer	state space, Kalman filter, unobserved components model, Durum Uzayı Modeli (State Space / Kalman Filter)
相关	3	4
摘要	Non-stationary Transformer is a Transformer-based time-series forecasting architecture introduced by Yong Liu, Haixu Wu, Jianmin Wang, and Mingsheng Long at NeurIPS 2022. It addresses a fundamental tension in applying Transformers to real-world time series: over-stationarization during preprocessing strips out non-stationary signals that carry predictive information, while raw non-stationary inputs cause attention to collapse. The model resolves this through series stationarization paired with a novel de-stationary attention mechanism that restores the original temporal distribution in predictions.	A state space model is a general time series framework that describes a series through unobserved (latent) state variables linked by a measurement equation and a transition equation, with the states estimated in real time by the Kalman filter. Developed in the state space tradition of Harvey (1990) and Durbin & Koopman (2012), it nests ARIMA and exponential smoothing as special cases.