@inproceedings{
liu2024hierachical,
title={Hierachical Multi-label Learning for Incremental Multilingual Text Recognition},
author={Xiaoqian Liu and Ming-Hui Liu and Zhen-Duo Chen and Xin Luo and Xin-Shun Xu},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=8mJZFBfLqb}
}
Multilingual text recognition (MLTR) is increasingly essential for facilitating cultural communication. However, existing methods often struggle with retaining previous language knowledge when learning new languages. A straightforward solution is performing incremental learning (IL) on MLTR tasks. However, it ignores the shared words and characters across incremental languages, which we first term as an incremental sharing problem. Motivated by this observation, we propose a HierArchical Multi-label learning framework for Multilingual tExt Recognition, termed HAMMER. An online knowledge analysis is designed to identify shared knowledge and provide corresponding multi-label language supervision. Specifically, only words and characters appearing simultaneously in multiple languages are considered shared knowledge. Additionally, to further capture language dependencies, we introduce a hierarchical language evaluation mechanism to predict language scores at word and character levels. These scores, supervised by the knowledge analysis, guide the specific recognizers to effectively utilize both old and new language knowledge, thereby mitigating catastrophic forgetting caused by imbalanced rehearsal sets. Extensive experiments conducted on benchmark datasets, MLT17 and MLT19, show that HAMMER exhibits remarkable results and outperforms other state-of-the-art approaches.
Hierarchical Multi-label Learning for Incremental Multilingual Text Recognition
Xiao-Qian Liu Ming-Hui Liu Zhen-Duo Chen Xin Luo Xin-Shun Xu