In addition to the above tasks which were considered by <cite>Conneau et al. (2017)</cite> , we also evaluate on the recently published Quora duplicate question dataset 6 since it is an order of magnitude larger than the others (approximately 400,000 question pairs).