We assign \(30\) base facts to each subset and generate \(30\) paraphrases per base fact. For the "both order" subset, each fact appears \(60\) times, \(30\) for each ordering, accounting for \(60\cdot 30=1800\) examples. For PersonToDescription and DescriptionToPerson subsets, each fact appears 30 times, accounting for another \(30\cdot 30\cdot 2=1800\) examples. Thus, the dataset has a total of \(3600\) examples. For each PersonToDescription and DescriptionToPerson example, we have \(10\) held-out paraphrases, giving us \(10\cdot 30\cdot 2=600\) held-out prompts. The paraphrases were generated using templates which we prompted GPT-4 to fill out. Some of these prompt templates are shown in Table 2.