The various systems were run using the skipgram variant with 500 dimensional vectors, maximum window size of 20 (10 in each direction), 5 negative examples, subsample ratio of 1e-6 (see <cite>[23]</cite> ), initial learning rate of 0.01875, and 3 iterations over the data set.