Vertaile menetelmiä

	Pyraformer	Informer
Tieteenala	Syväoppiminen	Syväoppiminen
Menetelmäperhe	Machine learning	Machine learning
Syntyvuosi	2022	2021
Kehittäjä	Shizhan Liu et al.	Zhou, H. et al.
Tyyppi	Pyramidal self-attention transformer for time-series forecasting	Transformer (ProbSparse self-attention)
Alkuperäislähde	Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A. X., & Dustdar, S. (2022). Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting. ICLR.	Zhou, H. et al. (2021). Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. AAAI.
Rinnakkaisnimet	Pyramidal Attention Transformer, Pyraformer Transformer, Piramit Dikkat Dönüştürücüsü, Low-Complexity Transformer	Informer — Uzun Dizi Transformer Tahmini, Informer transformer, ProbSparse attention forecaster
Liittyvät	3	5
Tiivistelmä	Pyraformer is a Transformer-based model for long-range time-series forecasting introduced by Liu et al. at ICLR 2022. Its central innovation is a Pyramidal Attention Module (PAM) that organizes tokens into a multi-resolution hierarchy, enabling the model to capture temporal dependencies across multiple scales while keeping time and memory complexity at O(L log L) rather than the quadratic cost of vanilla self-attention.	Informer is a Transformer-based model introduced by Zhou et al. in 2021 for long-sequence time-series forecasting, using a ProbSparse self-attention mechanism that lowers the computational complexity of the standard Transformer to O(L log L). It is built for problems that demand predictions across thousands of future steps.