In this section, we first fully specify our probe task before comparing the model of<cite> Zhang et al. (2017)</cite> to a simple bag-of-words model. Somewhat surprisingly, the latter substantially outperforms the former despite its relative simplicity.