Machine learningTime-series forecasting
iTransformer: Inverted Transformer for Multivariate Time-Series Forecasting
iTransformer is a deep-learning architecture for multivariate time-series forecasting introduced by Liu et al. at ICLR 2024. Its defining idea is to invert the conventional Transformer tokenisation strategy: instead of treating each time step as a token, iTransformer treats each variate (sensor channel or feature series) as a single token whose embedding encodes the full observed look-back window. Self-attention is then applied across variates to capture inter-series dependencies, while a feed-forward network within each token learns temporal patterns.
Open in MethodMindSoonVideoSoon
Read the full method
Members only
Sign inSign in with a free account to read this section.
Sources
- Liu, Y., Hu, T., Zhang, H., Wu, H., Wang, S., Ma, L., & Long, M. (2024). iTransformer: Inverted transformers are effective for time series forecasting. ICLR. link ↗