The results of the baselines on LexMTurk are from<cite> [Paetzold and Specia, 2017b]</cite> and the results on BenchLS and NNSeval are from<cite> [Paetzold and Specia, 2017a]</cite> . We can see that our method BERT-LS attains the highest Accuracy on three datasets, which has an average increase of 11.6% over the former state-of-theart baseline (Paetzold-NE).