Another relevant corpus, including cross-lingual sentence pairs, is PAWS-X [1]}. PAWS-X is derived from PAWS (Paraphrase Adversaries from Word Scrambling [2]}), containing challenging English sentence pairs from Wikipedia and Quora. The noisy paraphrase detection labeled sentence pairs highlight the importance of modeling structure, context, and word order information in the domain of paraphrase identification. PAWS-X contains 23,659 human translated and 296,406 machine-translated PAWS evaluation pairs in six typologically distinct languages: French, Spanish, German, Chinese, Japanese, and Korean. It contains only examples from PAWS-Wiki. In their paper, Yang et al. show the effectiveness of deep, multilingual pre-training on PAWS-X.
