Vertaile menetelmiä

	Non-stationary Transformer	Informer
Tieteenala	Syväoppiminen	Syväoppiminen
Menetelmäperhe	Machine learning	Machine learning
Syntyvuosi	2022	2021
Kehittäjä	Yong Liu et al.	Zhou, H. et al.
Tyyppi	Transformer-based time-series forecasting model	Transformer (ProbSparse self-attention)
Alkuperäislähde	Liu, Y., Wu, H., Wang, J., & Long, M. (2022). Non-stationary transformers: Exploring the stationarity in time series forecasting. NeurIPS.	Zhou, H. et al. (2021). Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. AAAI.
Rinnakkaisnimet	NS-Transformer, Non-stationary Transformer Network, Stationarization-based Transformer, Durağan-Olmayan Transformer	Informer — Uzun Dizi Transformer Tahmini, Informer transformer, ProbSparse attention forecaster
Liittyvät	3	5
Tiivistelmä	Non-stationary Transformer is a Transformer-based time-series forecasting architecture introduced by Yong Liu, Haixu Wu, Jianmin Wang, and Mingsheng Long at NeurIPS 2022. It addresses a fundamental tension in applying Transformers to real-world time series: over-stationarization during preprocessing strips out non-stationary signals that carry predictive information, while raw non-stationary inputs cause attention to collapse. The model resolves this through series stationarization paired with a novel de-stationary attention mechanism that restores the original temporal distribution in predictions.	Informer is a Transformer-based model introduced by Zhou et al. in 2021 for long-sequence time-series forecasting, using a ProbSparse self-attention mechanism that lowers the computational complexity of the standard Transformer to O(L log L). It is built for problems that demand predictions across thousands of future steps.