@inproceedings{
zhang2024video,
title={Video Anomaly Detection via Progressive Learning of Multiple Proxy Tasks},
author={Menghao Zhang and Jingyu Wang and Qi Qi and Pengfei Ren and Haifeng Sun and Zirui Zhuang and Huazheng Wang and Lei Zhang and Jianxin Liao},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=WsNFULCsyj}
}
Learning multiple proxy tasks is a popular training strategy in semi-supervised video anomaly detection. However, the traditional method of learning multiple proxy tasks simultaneously is prone to suboptimal solutions, and simply executing multiple proxy tasks sequentially cannot ensure continuous performance improvement. In this paper, we thoroughly investigate the impact of task composition and training order on performance enhancement. We find that ensuring continuous performance improvement in multi-task learning requires different but continuous optimization objectives in different training phases. To this end, a training strategy based on progressive learning is proposed to enhance the efficacy of multi-task learning in VAD. The learning objectives of the model in previous phases contribute to the training in subsequent phases. Specifically, we decompose video anomaly detection into three phases: perception, comprehension, and inference, continuously refining the learning objectives to enhance model performance. In the three phases, we perform the visual task, the semantic task and the open-set task in turn to train the model. The model learns different levels of features and focuses on different types of anomalies in different phases. Additionally, we design simple yet effective semantic leveraging the semantic consistency of context. Extensive experiments demonstrate the effectiveness of our method, highlighting that the benefits derived from the progressive learning transcend specific proxy tasks.
Video Anomaly Detection via Progressive Learning of Multiple Proxy Tasks
Menghao Zhang Jingyu Wang Qi Qi Pengfei Ren Haifeng Sun Zirui Zhuang Huazheng Wang Lei Zhang Jianxin Liao