Despite its simplicity, our method obtains performances on par with InferSent<cite> (Conneau et al., 2017)</cite> when using Glove representations (Pennington et al., 2014) as the source of pre-trained word vectors.