Neural Network-based Word Alignment through Score Aggregation
J Legrand, M Auli, R Collobert - arXiv preprint arXiv:1606.09560, 2016
... For LSE, we set r = 1 in (4). We initialize the word embeddings with a simple PCA computed over the matrix of word co- occurrence counts (Lebret and Collobert, 2014). The co-occurrence counts were computed over the common crawl corpus provided by WMT16. ...