Breaking away from the non-distributed (high-dimensional, sparse) representations of words, typical of traditional bag-of-words or one-hot-encoding (Turian et al. (2010) ), <cite>Mikolov et al. (2013a)</cite> created word2vec.