This problem has lately raised severe concerns in the word embedding community (e.g., Hellrich and Hahn (2016b) ;<cite> Antoniak and Mimno (2018)</cite> ; Wendlandt et al. (2018) ) and is also of interest to the wider machine learning community due to the influence of probabilistic-and thus unstablemethods on experimental results (Reimers and Gurevych, 2017; Henderson et al., 2018) , as well as replicability and reproducibility (Ivie and Thain, 2018, pp.