In this paper, we investigate a state-of-the-art paragraph embedding method proposed by<cite> Zhang et al. (2017)</cite> and discover that it cannot reliably tell whether a given sentence occurs in the input paragraph or not.