Barkan (2017) pointed out that the skip-gram model with negative sampling, also known as word2vec <cite>(Mikolov et al., 2013b)</cite> , admits a Bayesian interpretation. The Bayesian skip-gram model allows uncertainty to be taken into account in a principled way, and lays the basis for our proposed Bayesian paragraph vector model.