<cite>Gulordava et al. (2018)</cite> also start with existing sentences. However, in order to control for the possibillity of the model learning to rely on "semantic" selectional-preferences cues rather than syntactic ones, <cite>they</cite> replace each content word with random words from the same part-ofspeech and inflection. This results in "<cite>coloreless green ideas</cite>" nonce sentences.