In addition to performing 10-fold cross-validation to determine the L2 regularization penalty on the logistic regression models, we also tune the way in which our sentence representations are generated from the hidden states corresponding to words in a sentence. For example, use the last hidden state while <cite>Conneau et al. (2017)</cite> perform max-pooling across all of the hidden states. We consider both of these approaches and pick the one with better performance on the validation set.