To train the word embeddings, we experimented with three algorithms: word2vec (Mikolov et al., 2013b) , <cite>fastText</cite> (<cite>Bojanowski et al., 2017</cite>) , and GloVe (Pennington et al., 2014) . We used gensim 3 to run word2vec and <cite>fastText</cite> and the original C implementation for GloVe. 4 For all three, we used <cite>their</cite> default hyperparameters, i.e. no tuning was performed.