In a recent lexical substitution annotation effort<cite> (Kremer et al., 2014)</cite> , we collected lexical substitution annotation for all nouns, verbs, and adjectives in a mixed news and fiction corpus, using untrained annotators via crowdsourcing.