Moirai: Universal Time-Series Forecasting Transformer

Moirai is a foundation model for universal time-series forecasting introduced by Gerald Woo and colleagues at Salesforce Research in 2024 and presented at ICML. The core idea is to pre-train a single large Transformer on an exceptionally diverse corpus of time-series data (LOTSA) spanning many domains and frequencies, enabling zero-shot and few-shot forecasting on unseen datasets without task-specific retraining. Moirai employs patch-based tokenization, any-variate attention, and a mixture-of-distributions output head to handle variable frequencies, multiple variates, and probabilistic prediction in a unified architecture.