In prior context-aware simplification systems, the decision of whether to apply a simplification rule in an input sentence is complex, involving several similarity operations on word co-occurrence matrices<cite> (Biran et al., 2011)</cite> or using embeddings to incorporate co-occurrence context for pairs generated using other means (Paetzold and Specia, 2015) .