We follow the fine-tuning setting of the existing work <cite>(Devlin et al., 2019</cite>; : Sentence-level Sentiment Classification: The input of this task is a text sequence ([CLS], x 1 , x 2 , · · · , x n , [SEP]).