विधियों की तुलना करें

	सुधारक: लंबी अनुक्रमों के लिए कुशल ट्रांसफार्मर	सूचनाकर्ता
क्षेत्र	गहन अधिगम	गहन अधिगम
परिवार	Machine learning	Machine learning
उद्भव वर्ष	2020	2021
प्रवर्तक	Nikita Kitaev, Łukasz Kaiser & Anselm Levskaya	Zhou, H. et al.
प्रकार	Memory-efficient attention-based sequence model	Transformer (ProbSparse self-attention)
मौलिक स्रोत	Kitaev, N., Kaiser, Ł., & Levskaya, A. (2020). Reformer: The efficient transformer. ICLR.	Zhou, H. et al. (2021). Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. AAAI.
उपनाम	Efficient Transformer, LSH Transformer, Locality-Sensitive Hashing Transformer, Verimli Dönüştürücü	Informer — Uzun Dizi Transformer Tahmini, Informer transformer, ProbSparse attention forecaster
संबंधित	2	5
सारांश	The Reformer is an efficient variant of the Transformer architecture introduced by Kitaev, Kaiser, and Levskaya at ICLR 2020. It addresses the prohibitive O(L²) memory and computational cost of standard self-attention for long sequences. The key innovations are locality-sensitive hashing (LSH) attention, which approximates full attention in O(L log L) time, and reversible residual layers that dramatically reduce activation memory during training.	Informer is a Transformer-based model introduced by Zhou et al. in 2021 for long-sequence time-series forecasting, using a ProbSparse self-attention mechanism that lowers the computational complexity of the standard Transformer to O(L log L). It is built for problems that demand predictions across thousands of future steps.