One thing to note is that the SCWS Spearman scores of the<cite> (Huang et al., 2012)</cite> listed here are much smaller than that first reported. This is entirely attributed to the fact that we use direct cosine similarity between word embeddings, whereas they use an averaged similarity across their provided context words.