Traditional natural language processing tasks typically employ statistic-based algorithms (Hogenboom et al., 2010)Serra et al. (2013)Aussenac-Gilles and Sorgel (2005) and deep learning algorithms such as convolutional neural network (CNN) (Yin et al., 2017), recurrent neural network (RNN) (Banerjee et al., 2019), long short-term memory network (LSTM) (Yao and Guan, 2018), and others. Recently, with the advent of the transformer architecture (Vaswani et al., 2017) as a leading representative of natural language processing, its popularity has grown significantly. The transformer architecture, as a prominent large language model (Lewis et al., 2019)Raffel et al. (2020) in the natural language processing domain, has consistently demonstrated enhanced performance, attracting the attention of an increasing number of researchers who are engaged in studying its capabilities.