We show how the choice of down-sampling strategies, a seemingly minor detail, leads to major differences in the characterization of SVD PPMI in recent studies (Hellrich and Hahn, 2017;<cite> Antoniak and Mimno, 2018)</cite> .