Recently, several variations of convolutional neural networks (CNNs) [7] have been shown to achieve high accuracy on text categorization (see e.g., [3, <cite>4,</cite> 9, 1] and references therein) in comparison with a number of methods including linear methods, which had long been the state of the art.