validation/test loss with unlabeled data is not a good proxy for task performance, atleast in this domain. This is supported by [16]'s observations on low correlation between task performance and pre-training loss.