Besides, using a small corpus, we obtain better human-assigned WordSim scores, corresponding Spearman correlation and better downstream (NER & SA) performance compared to <cite>Mikolov'</cite>s model, trained on 100 billion word corpus.