@inproceedings{
fu2024comonas,
title={Co{MO}-{NAS}: Core-Structures-Guided Multi-Objective Neural Architecture Search for Multi-Modal Classification},
author={Pinhan Fu and Xinyan Liang and Yuhua Qian and Qian Guo and Zhifang Wei and Wen Li},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=4NyjtVHiv8}
}
Most existing NAS-based multi-modal classification (MMC-NAS) methods are optimized using the classification accuracy. They can not simultaneously provide multiple models with diverse perferences such as model complex and classification performance for meeting different users' demands.Combining NAS-MMC with multi-objective optimization is a nature way for this issue. However, the challenge problem of this solution is the high computation cost. For multi-objective optimization, the computing bottleneck is pareto front search. Some higher-quality MMC models (namely core structures, CSs) consisting of high-quality features and fusion operators are easier to identify. We find that CSs have a close relation with the pareto front (PF), i.e., the individuals lying in PF contain the CSs. Based on the finding, we propose an efficient multi-objective neural architecture search for multi-modal classification by applying CSs to guide the PF search (CoMO-NAS). In conclusion, experimental results thoroughly demonstrate the effectiveness of our CoMO-NAS. Compared to state-of-the-art competitors on benchmark multi-modal tasks, we achieve comparable performance with lower model complexity in shorter search time.
CoMO-NAS: Core-Structures-Guided Multi-Objective Neural Architecture Search for Multi-Modal Classification
Pinhan Fu Xinyan Liang Yuhua Qian Qian Guo Zhifang Wei Wen Li