I use the stimuli provided by (Linzen et al., 2016; <cite>Gulordava et al., 2018</cite>; Marvin and Linzen, 2018) , but change the experimental protocol to adapt it to the bidirectional nature of the BERT model.