We are interested in modifying the Skipgram Negative-Sampling (SGNS) objective in<cite> (Mikolov et al., 2013)</cite> to utilize document-wide feature vectors while simultaneously learning continuous document weights loading onto topic vectors.