As word embeddings with lower dimensionality may improve efficiency and generalization <cite>(Levy et al., 2015)</cite> , the improved PPMI * matrix can be factorized as a product of two lower rank matrices.