We evaluate the large Transformer model via human assessment, on two kinds of test sets. The first kind of test sets (TrainSub) contains 100 randomly sampled input examples from the model's training data. The second kind of test sets (COPA_Dev) contains 100 randomly sampled examples from the development set of COPA [1]} dataset, which are manually created gold sentences and never seen during the model's training stage.
