Metodebevisregistrering

Reformer

The Reformer is an efficient variant of the Transformer architecture introduced by Kitaev, Kaiser, and Levskaya at ICLR 2020. It addresses the prohibitive O(L²) memory and computational cost of standard self-attention for long sequences. The key innovations are locality-sensitive hashing (LSH) attention, which approximates full attention in O(L log L) time, and reversible residual layers that dramatically reduce activation memory during training.

Sources recorded, not reviewed

Kilderegistrering

Citater kopieret ordret fra metodens kilderegistrering. Ingen påstandsniveauverifikation er udledt heraf.

Reformer (The Efficient Transformer)

Taksonomisk metoderegistrering · ml-model / deep-learning

Kitaev, N., Kaiser, Ł., & Levskaya, A. (2020). Reformer: The efficient transformer. ICLR. · URL

Åbn fuld metode

Kuraterede påstande

Påstande gemt i bevis-loggen, hver med sin egen vurdering.

Ingen kuraterede påstande endnu

Denne visning opfinder ikke en påstandsvurdering, når loggen ingen har.

Relaterede metoder

Genereret fra metodegrafen og vist som maskinelt foreslåede relationer — ingen bevispåstand er udledt.

Same method familyInformermachine-suggested · Relational suggestion, not evidence.Taxonomic bucketPyraformermachine-suggested · Relational suggestion, not evidence.