ScholarGate
Msaidizi

Linganisha mbinu

Pitia mbinu ulizochagua bega kwa bega; safu zinazotofautiana zinaangaziwa.

Reformer: Transformer yenye ufanisi kwa Milisho Mirefu×Mtoa habari×
NyanjaUjifunzaji wa KinaUjifunzaji wa Kina
FamiliaMachine learningMachine learning
Mwaka wa asili20202021
MwanzilishiNikita Kitaev, Łukasz Kaiser & Anselm LevskayaZhou, H. et al.
AinaMemory-efficient attention-based sequence modelTransformer (ProbSparse self-attention)
Chanzo asiliaKitaev, N., Kaiser, Ł., & Levskaya, A. (2020). Reformer: The efficient transformer. ICLR. link ↗Zhou, H. et al. (2021). Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. AAAI. DOI ↗
Majina mbadalaEfficient Transformer, LSH Transformer, Locality-Sensitive Hashing Transformer, Verimli DönüştürücüInformer — Uzun Dizi Transformer Tahmini, Informer transformer, ProbSparse attention forecaster
Zinazohusiana25
MuhtasariThe Reformer is an efficient variant of the Transformer architecture introduced by Kitaev, Kaiser, and Levskaya at ICLR 2020. It addresses the prohibitive O(L²) memory and computational cost of standard self-attention for long sequences. The key innovations are locality-sensitive hashing (LSH) attention, which approximates full attention in O(L log L) time, and reversible residual layers that dramatically reduce activation memory during training.Informer is a Transformer-based model introduced by Zhou et al. in 2021 for long-sequence time-series forecasting, using a ProbSparse self-attention mechanism that lowers the computational complexity of the standard Transformer to O(L log L). It is built for problems that demand predictions across thousands of future steps.
ScholarGateSeti ya data
  1. v1
  2. 1 Vyanzo
  3. PUBLISHED
  1. v1
  2. 2 Vyanzo
  3. PUBLISHED

Nenda kwenye utafutaji Pakua slaidi

ScholarGateLinganisha mbinu: Reformer · Informer. Imepatikana 2026-06-18 kutoka https://scholargate.app/sw/compare