We follow a similar evaluation protocol to those presented in ; Hill et al. (2016) ; <cite>Conneau et al. (2017)</cite> which is to use our learned representations as features for a low complexity classifier (typically linear) on a novel supervised task/domain unseen during training without updating the parameters of our sentence representation model.