Our method leverages <cite>Cotterell et al. (2017)</cite> 's formulation of Mikolov et al. (2013) 's popular skip-gram model as exponential family principal component analysis (EPCA) and tensor factorization.