Metodebevisregister

Reformer

The Reformer is an efficient variant of the Transformer architecture introduced by Kitaev, Kaiser, and Levskaya at ICLR 2020. It addresses the prohibitive O(L²) memory and computational cost of standard self-attention for long sequences. The key innovations are locality-sensitive hashing (LSH) attention, which approximates full attention in O(L log L) time, and reversible residual layers that dramatically reduce activation memory during training.

Sources recorded, not reviewed

Kilderegister

Siteringer kopiert ordrett fra metodens kilderegister. Ingen påstandsnivåverifisering er underforstått fra dem.

Reformer (The Efficient Transformer)

Taksonomisk metoderegister · ml-model / deep-learning

Kitaev, N., Kaiser, Ł., & Levskaya, A. (2020). Reformer: The efficient transformer. ICLR. · URL

Åpne full metode

Kuraterte påstander

Påstander lagret i bevishovedboken, hver med sin egen vurdering.

Ingen kuraterte påstander ennå

Denne visningen finner ikke opp en påstandsvurdering når hovedboken ikke har noen.

Relaterte metoder

Generert fra metodegrafen og vist som maskinforslåtte relasjoner – ingen bevispåstand er underforstått.

Same method familyInformermachine-suggested · Relational suggestion, not evidence.Taxonomic bucketPyraformermachine-suggested · Relational suggestion, not evidence.