Following (Baroni, Dinu, and Kruszewski 2014; Schnabel et al. 2015;<cite> Mu and Viswanath 2018)</cite> , we used "purity" of clusters (Manning, Raghavan, and Schütze 2008, Section 16.4) as the evaluation criterion.