The newly constructed datasets UpdatedLAMA, NewLAMA, and NewLAMA-Easy require multi-token decoding which adds a level of difficulty for the task compared to InvariantLAMA. Moreover, NewLAMA-Easy has a different input distribution (longer input sequences) than the other datasets since the decontextualization and back-translation processes are applied to create each instance, which makes the sentences longer. Lastly, some examples of the CKL benchmark datasets are provided in Table 6.