So sánh phương pháp
Xem các phương pháp đã chọn cạnh nhau; những hàng khác biệt được làm nổi bật.
| Reformer: Bộ biến đổi hiệu quả cho chuỗi dài× | Informer× | |
|---|---|---|
| Lĩnh vực | Học sâu | Học sâu |
| Họ | Machine learning | Machine learning |
| Năm ra đời≠ | 2020 | 2021 |
| Người khởi xướng≠ | Nikita Kitaev, Łukasz Kaiser & Anselm Levskaya | Zhou, H. et al. |
| Loại≠ | Memory-efficient attention-based sequence model | Transformer (ProbSparse self-attention) |
| Công trình gốc≠ | Kitaev, N., Kaiser, Ł., & Levskaya, A. (2020). Reformer: The efficient transformer. ICLR. link ↗ | Zhou, H. et al. (2021). Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. AAAI. DOI ↗ |
| Tên gọi khác≠ | Efficient Transformer, LSH Transformer, Locality-Sensitive Hashing Transformer, Verimli Dönüştürücü | Informer — Uzun Dizi Transformer Tahmini, Informer transformer, ProbSparse attention forecaster |
| Liên quan≠ | 2 | 5 |
| Tóm tắt≠ | The Reformer is an efficient variant of the Transformer architecture introduced by Kitaev, Kaiser, and Levskaya at ICLR 2020. It addresses the prohibitive O(L²) memory and computational cost of standard self-attention for long sequences. The key innovations are locality-sensitive hashing (LSH) attention, which approximates full attention in O(L log L) time, and reversible residual layers that dramatically reduce activation memory during training. | Informer is a Transformer-based model introduced by Zhou et al. in 2021 for long-sequence time-series forecasting, using a ProbSparse self-attention mechanism that lowers the computational complexity of the standard Transformer to O(L log L). It is built for problems that demand predictions across thousands of future steps. |
| ScholarGateBộ dữ liệu ↗ |
|
|