เปรียบเทียบวิธี

	Pyraformer: Pyramidal Attention Transformer สำหรับการพยากรณ์อนุกรมเวลาช่วงยาว	Autoformer: Decomposition Transformer สำหรับการพยากรณ์อนุกรมเวลาในระยะยาว
สาขาวิชา	การเรียนรู้เชิงลึก	การเรียนรู้เชิงลึก
ตระกูล	Machine learning	Machine learning
ปีกำเนิด	2022	2021
ผู้ริเริ่ม	Shizhan Liu et al.	Haixu Wu et al. (Tsinghua)
ประเภท	Pyramidal self-attention transformer for time-series forecasting	Decomposition-based deep forecasting model
แหล่งต้นตำรับ	Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A. X., & Dustdar, S. (2022). Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting. ICLR.	Wu, H., Xu, J., Wang, J., & Long, M. (2021). Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting. NeurIPS, 34.
ชื่อเรียกอื่น	Pyramidal Attention Transformer, Pyraformer Transformer, Piramit Dikkat Dönüştürücüsü, Low-Complexity Transformer	Auto-Correlation Transformer, Decomposition Transformer, Series Decomposition Forecaster, Oto-Korelasyon Ayrışım Transformer
ที่เกี่ยวข้อง	3	4
สรุป	Pyraformer is a Transformer-based model for long-range time-series forecasting introduced by Liu et al. at ICLR 2022. Its central innovation is a Pyramidal Attention Module (PAM) that organizes tokens into a multi-resolution hierarchy, enabling the model to capture temporal dependencies across multiple scales while keeping time and memory complexity at O(L log L) rather than the quadratic cost of vanilla self-attention.	Autoformer is a deep learning architecture for long-term time-series forecasting, introduced by Wu et al. from Tsinghua University at NeurIPS 2021. It replaces the standard self-attention mechanism with an Auto-Correlation mechanism that exploits periodic dependencies in the frequency domain, and embeds a progressive series decomposition block throughout the encoder and decoder to separately model trend and seasonal components.