Due to the sparsity of aspect terms compared with aspect categories, our model improved a larger margin on the task of aspect category sentiment classification than the<cite> (Devlin et al., 2019)</cite> .