Pyraformer: Transformer yenye Hisia za Piramidi kwa Utabiri wa Milango Mrefu wa Mfululizo wa Wakati
Pyraformer ni modeli inayotegemea Transformer kwa utabiri wa milango mirefu wa mfululizo wa wakati iliyoanzishwa na Liu et al. katika ICLR 2022. Ubunifu wake mkuu ni Moduli ya Hisia ya Piramidi (PAM) ambayo hupanga tokeni katika mfumo wa ngazi mbalimbali za azimio, ikiwezesha modeli kukamata utegemezi wa muda katika mizani mbalimbali huku ikidumisha ugumu wa muda na kumbukumbu katika O(L log L) badala ya gharama ya mraba ya hisia za kawaida.
Soma mbinu kamili
Ingia kwa akaunti ya bure ili kusoma sehemu hii.
Method map
The neighbourhood of related methods — select a node to explore.
Vyanzo
- Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A. X., & Dustdar, S. (2022). Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting. ICLR. link ↗
Jinsi ya kunukuu ukurasa huu
ScholarGate. (2026, June 2). Pyraformer (Pyramidal Attention for Long-Range Forecasting). ScholarGate. https://scholargate.app/sw/deep-learning/pyraformer
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Autoformer: Transformer ya Uharibifu kwa Utabiri wa Milipuko ya Muda MrefuUjifunzaji wa Kina↔ compare
- Mtoa habariUjifunzaji wa Kina↔ compare
- Reformer: Transformer yenye ufanisi kwa Milisho MirefuUjifunzaji wa Kina↔ compare
Imerejelewa na
Umeona tatizo kwenye ukurasa huu? Ripoti au pendekeza marekebisho →