Below we describe our motivation towards the proposal of our novel representation: (1) Some neural-based paragraph representations such as paragraph vectors (Le and Mikolov, 2014) , FastSent<cite> (Hill et al., 2016)</cite> use a shared space between the words and paragraphs.