The results of the baselines on LexMTurk are from<cite> [Paetzold and Specia, 2017b]</cite> and the results on BenchLS and NNSeval are from<cite> [Paetzold and Specia, 2017a]</cite> . As can be seen, despite being entirely unsupervised, our model BERT-LS obtains F1 scores on three 7 http://ghpaetzold.github.io/data/NNSeval.zip datasets, largely outperforming the previous best baselines.