Khanpour et al. (2016) used pre-trained embeddings using both approaches in their study and achieved their best results using Word2Vec embeddings trained on Wikipedia data. <cite>Liu et al. (2017)</cite> also used Word2Vec embeddings, but trained on Facebook data.