Krahasoni metodat

	Pyraformer	Autoformer	Informer
Fusha	Mësimi i thellë	Mësimi i thellë	Mësimi i thellë
Familja	Machine learning	Machine learning	Machine learning
Viti i origjinës	2022	2021	2021
Krijuesi	Shizhan Liu et al.	Haixu Wu et al. (Tsinghua)	Zhou, H. et al.
Lloji	Pyramidal self-attention transformer for time-series forecasting	Decomposition-based deep forecasting model	Transformer (ProbSparse self-attention)
Burimi themelues	Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A. X., & Dustdar, S. (2022). Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting. ICLR.	Wu, H., Xu, J., Wang, J., & Long, M. (2021). Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting. NeurIPS, 34.	Zhou, H. et al. (2021). Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. AAAI.
Emërtime të tjera	Pyramidal Attention Transformer, Pyraformer Transformer, Piramit Dikkat Dönüştürücüsü, Low-Complexity Transformer	Auto-Correlation Transformer, Decomposition Transformer, Series Decomposition Forecaster, Oto-Korelasyon Ayrışım Transformer	Informer — Uzun Dizi Transformer Tahmini, Informer transformer, ProbSparse attention forecaster
Të lidhura	3	4	5
Përmbledhja	Pyraformer is a Transformer-based model for long-range time-series forecasting introduced by Liu et al. at ICLR 2022. Its central innovation is a Pyramidal Attention Module (PAM) that organizes tokens into a multi-resolution hierarchy, enabling the model to capture temporal dependencies across multiple scales while keeping time and memory complexity at O(L log L) rather than the quadratic cost of vanilla self-attention.	Autoformer is a deep learning architecture for long-term time-series forecasting, introduced by Wu et al. from Tsinghua University at NeurIPS 2021. It replaces the standard self-attention mechanism with an Auto-Correlation mechanism that exploits periodic dependencies in the frequency domain, and embeds a progressive series decomposition block throughout the encoder and decoder to separately model trend and seasonal components.	Informer is a Transformer-based model introduced by Zhou et al. in 2021 for long-sequence time-series forecasting, using a ProbSparse self-attention mechanism that lowers the computational complexity of the standard Transformer to O(L log L). It is built for problems that demand predictions across thousands of future steps.