Although the optimal value of p is highly task-dependent (Österlund et al., 2015) , we set p = 0.5 as it has been shown to perform well on the word similarity and analogy tasks we use in our experiments <cite>(Levy et al., 2015)</cite> .