Compared to the previous NRC Canada 2013 approach <cite>(Mohammad et al., 2013)</cite> , our main changes are the following three: First we use sparse linear classifiers instead of classical dense ones.