@inproceedings{
wu2024multiview,
title={Multi-view Self-Supervised Contrastive Learning for Multivariate Time Series},
author={Yuhan Wu and Xiyu Meng and Yang He and Junru Zhang and Haowen Zhang and Yabo Dong and Dongming Lu},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=BgjLy3chju}
}
Learning semantic-rich representations from unlabeled time series data with intricate dynamics is a notable challenge. Traditional contrastive learning techniques predominantly focus on segment-level augmentations through time slicing, a practice that, while valuable, often results in sampling bias and suboptimal performance due to the loss of global context. Furthermore, they typically disregard the vital frequency information to enrich data representations. To this end, we propose a novel self-supervised general-purpose framework called Temporal-Frequency and Contextual Consistency (TFCC). Specifically, This framework first performs two instance-level augmentation families over the entire series to capture nuanced representations alongside critical long-term dependencies. Then, TFCC advances by initiating dual cross-view forecasting tasks between the original series and its augmented counterpart in both time and frequency dimensions to learn robust representations. Finally, three specially designed consistency modules —temporal, frequency, and temporal-frequency— aid in further developing discriminative representations on top of the learned robust representations. Extensive experiments on multiple benchmark datasets demonstrate TFCC's superiority over the state-of-the-art classification and forecasting methods and exhibit exceptional efficiency in semi-supervised and transfer learning scenarios. Code, data, and model checkpoints will be released after the review period.
Multi-view Self-Supervised Contrastive Learning for Multivariate Time Series
Yuhan Wu Xiyu Meng Yang He Junru Zhang Haowen Zhang Yabo Dong Dongming Lu