Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecasting
The performance of time series forecasting has recently been greatly improved
by the introduction of transformers. In this paper, we propose a general
multi-scale framework that can be applied to state-of-the-art transformer-based
time series forecasting models including Autoformer and Informer. Using
iteratively refining a forecasted time series at multiple scales with shared
weights, architecture adaptations and a specially-designed normalization
scheme, we are able to achieve significant performance improvements with
minimal additional computational overhead. Via detailed ablation studies, we
demonstrate the effectiveness of our proposed architectural and methodological
innovations. Furthermore, our experiments on four public datasets show that the
proposed multi-scale framework outperforms the corresponding baselines with an
average improvement of 13% and 38% over Autoformer and Informer, respectively.