For experiments with continuous space feature representations (a.k.a., word embeddings), we took the word embeddings (130K words, 50 dimensions) used in <cite>Collobert et al. (2011)</cite> , which were trained for 2 months over Wikipedia text.